Sep 25 21:00:53 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 25 21:00:53 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 25 21:00:53 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 25 21:00:54 devstack cinder-volume[76545]: INFO dbcounter [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Registered counter for database cinder Sep 25 21:00:54 devstack cinder-volume[76545]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:00:55 devstack cinder-volume[76545]: DEBUG dbcounter [-] [76545] Writer thread running {{(pid=76545) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 25 21:00:55 devstack cinder-volume[76545]: INFO cinder.rpc [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 21:00:55 devstack cinder-volume[76545]: INFO cinder.rpc [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 21:00:55 devstack cinder-volume[76545]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:00:55 devstack cinder-volume[76545]: INFO cinder.volume.manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Determined volume DB was empty at startup. Sep 25 21:00:55 devstack cinder-volume[76545]: DEBUG cinder.volume.manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76545) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 25 21:00:55 devstack cinder-volume[76545]: INFO cinder.volume.manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 21:00:55 devstack cinder-volume[76545]: WARNING stevedore.named [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:00:55 devstack cinder-volume[76545]: WARNING castellan.key_manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:00:55 devstack cinder-volume[76545]: WARNING cinder.keymgr.conf_key_mgr [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:00:55 devstack cinder-volume[76545]: DEBUG cinder.volume.drivers.lvm [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76545) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 25 21:00:55 devstack cinder-volume[76545]: DEBUG oslo_concurrency.processutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76545) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:56 devstack cinder-volume[76545]: DEBUG oslo_concurrency.processutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] CMD "cinder-rtstool verify" returned: 0 in 0.957s {{(pid=76545) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:00:56 devstack cinder-volume[76545]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:00:56 devstack cinder-volume[76545]: INFO cinder.rpc [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 21:00:56 devstack cinder-volume[76545]: INFO cinder.rpc [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 21:00:56 devstack cinder-volume[76545]: WARNING stevedore.named [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:00:56 devstack cinder-volume[76545]: WARNING castellan.key_manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:00:56 devstack cinder-volume[76545]: INFO cinder.volume.manager [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 21:00:56 devstack cinder-volume[76545]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:00:56 devstack cinder-volume[76545]: INFO oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Starting 1 workers Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Started child 76676 {{(pid=76545) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Full set of CONF: {{(pid=76545) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] ******************************************************************************** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Configuration options gathered from: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] ================================================================================ {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] allow_availability_zone_fallback = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] allow_compression_on_image_upload = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] allowed_direct_url_schemes = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] api_rate_limit = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] auth_strategy = keystone {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] az_cache_duration = 3600 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_availability_zone = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_host = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_stats_polling_interval = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backup_api_class = cinder.backup.api.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backup_name_template = backup-%s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backup_use_same_host = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backup_use_temp_snapshot = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] chap_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] chap_username = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_internal_tenant_project_id = f871f7fb00d14c0f86c53ce69f47d186 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_internal_tenant_user_id = 0345032cc1c64d90bc6a54ab08ac5fe9 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cloned_volume_same_az = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cluster = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] compression_format = gzip {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] compute_api_class = cinder.compute.nova.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] config_dir = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76676]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] config_source = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] control_exchange = openstack {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] debug = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] default_availability_zone = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] default_group_type = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] default_volume_type = lvmdriver-1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_client_cert = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_client_cert_key = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_data_namespace = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_ssl_cert_path = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_ssl_cert_verify = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] driver_use_ssl = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] enable_force_upload = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] enable_new_services = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] enable_unsupported_driver = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] enforce_multipath_for_image_xfer = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] filter_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_api_insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_api_servers = ['http://192.168.122.83/image'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_api_ssl_compression = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_ca_certificates_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_catalog_info = image:glance:publicURL {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_num_retries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance_request_timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] goodness_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] graceful_shutdown_timeout = 5 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] group_api_class = cinder.group.api.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] host = devstack {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_compress_on_upload = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_conversion_address_space_limit = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_conversion_cpu_limit = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_conversion_disable = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_upload_use_cinder_backend = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_upload_use_internal_tenant = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_volume_cache_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_volume_cache_max_count = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] image_volume_cache_max_size_gb = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] init_host_max_objects_retrieval = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] instance_format = [instance: %(uuid)s] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iscsi_iotype = fileio {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iscsi_target_flags = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iscsi_write_cache = on {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iser_helper = tgtadm {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iser_ip_address = 192.168.122.83 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iser_port = 3260 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_color = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_config_append = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_dir = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_options = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_rotate_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_rotate_interval_type = days {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] log_rotation_type = none {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] max_age = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] max_logfile_count = 30 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] max_logfile_size_mb = 200 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] max_over_subscription_ratio = 20.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] message_reap_interval = 86400 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] message_ttl = 2592000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] migration_create_volume_timeout_secs = 300 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] monkey_patch = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] monkey_patch_modules = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] my_ip = 192.168.122.83 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] no_snapshot_gb_quota = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] num_iser_scan_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] num_shell_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] num_volume_device_scan_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] nvmeof_conn_info_version = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] nvmet_ns_id = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] nvmet_port_id = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_max_limit = 1000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_ext_list = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_listen_port = 8776 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_use_ssl = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] osapi_volume_workers = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] per_volume_size_limit = -1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] periodic_fuzzy_delay = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] periodic_interval = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] public_endpoint = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] publish_errors = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_backup_gigabytes = 1000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_backups = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_gigabytes = 1000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_groups = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_snapshots = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] quota_volumes = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] rate_limit_burst = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] rate_limit_except_level = CRITICAL {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] rate_limit_interval = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] reinit_driver_count = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] replication_device = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] report_discard_supported = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] report_interval = 120 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] reservation_clean_interval = 86400 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] reservation_expire = 86400 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] reserved_image_namespaces = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] reserved_percentage = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] rpc_response_timeout = 120 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] run_external_periodic_tasks = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] scst_target_driver = iscsi {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] scst_target_iqn_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_down_time = 720 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] shell_completion = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] snapshot_name_template = snapshot-%s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] snapshot_same_host = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] split_loggers = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] state_path = /opt/stack/data/cinder {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] storage_availability_zone = nova {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] storage_protocol = iSCSI {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] syslog_log_facility = LOG_USER {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_helper = lioadm {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_ip_address = 192.168.122.83 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_port = 3260 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_protocol = iscsi {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] target_secondary_ip_addresses = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] trace_flags = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] transport_url = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] until_refresh = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_chap_auth = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_default_quota_class = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_journal = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_json = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_multipath_for_image_xfer = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_stderr = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] use_syslog = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] verify_glance_signatures = enabled {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_api_class = cinder.volume.api.API {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_backend_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_clear = zero {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_clear_ionice = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_clear_size = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_copy_bps_limit = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_dd_blocksize = 1M {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_name_template = volume-%s {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_service_inithost_offload = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volume_usage_audit_period = month {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] watch_log_file = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] zoning_mode = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_concurrency.disable_process_locking = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.admin_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.admin_token = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.admin_user = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_admin_prefix = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_port = 35357 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_protocol = https {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_section = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_type = password {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_uri = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.auth_version = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.cache = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.identity_uri = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.include_service_catalog = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.interface = public {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_password = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcache_username = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.region_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.service_type = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.backend = dogpile.cache.null {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.backend_argument = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.backend_expiration_time = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.config_prefix = cache.oslo {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.dead_timeout = 60.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.debug_cache_backend = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.enable_retry_client = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.enable_socket_keepalive = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.enforce_fips_mode = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.expiration_time = 600 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.hashclient_retry_attempts = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.hashclient_retry_delay = 1.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_dead_retry = 300 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_pool_maxsize = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_sasl_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_socket_timeout = 1.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.memcache_username = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.proxies = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_db = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_server = localhost:6379 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_socket_timeout = 1.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.redis_username = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.retry_attempts = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.retry_delay = 0.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.socket_keepalive_count = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.socket_keepalive_idle = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.socket_keepalive_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.tls_allowed_ciphers = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.tls_cafile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.tls_certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.tls_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cache.tls_keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] coordination.backend_url = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.asyncio_connection = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.asyncio_slave_connection = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.backend = sqlalchemy {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.connection = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.connection_debug = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.connection_parameters = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.connection_recycle_time = 3600 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.connection_trace = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.db_inc_retry_interval = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.db_max_retries = 20 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.db_max_retry_interval = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.db_retry_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.max_overflow = 50 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.max_pool_size = 5 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.max_retries = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.mysql_wsrep_sync_wait = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.pool_timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.retry_interval = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.slave_connection = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.sqlite_synchronous = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] database.use_db_reconnect = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.connection_string = messaging:// {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.es_doc_type = notification {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.es_scroll_size = 10000 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.es_scroll_time = 2m {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.filter_error_trace = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.hmac_keys = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.sentinel_service_name = mymaster {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.socket_timeout = 0.1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.trace_requests = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler.trace_sqlalchemy = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler_jaeger.process_tags = {} {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler_jaeger.service_name_prefix = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] profiler_otlp.service_name_prefix = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.enforce_new_defaults = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: WARNING oslo_config.cfg [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.enforce_scope = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.policy_default_rule = default {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.policy_file = policy.yaml {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.group = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.helper_command = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] privsep_osbrick.user = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.group = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.helper_command = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] cinder_sys_admin.user = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.auth_section = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.auth_type = password {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.collect_timing = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.send_service_user_token = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.split_loggers = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] service_user.timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.auth_section = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.auth_type = password {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.collect_timing = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.split_loggers = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] glance.timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.backend_availability_zone = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.chap_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.chap_username = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_client_cert = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_client_cert_key = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_data_namespace = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.driver_use_ssl = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.extra_capabilities = {} {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.filter_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.goodness_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iscsi_iotype = fileio {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iscsi_target_flags = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iscsi_write_cache = on {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iser_helper = tgtadm {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iser_ip_address = 192.168.122.83 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iser_port = 3260 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.lvm_share_target = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.lvm_type = auto {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.num_shell_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.replication_device = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.report_discard_supported = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.reserved_percentage = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_helper = tgtadm {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_ip_address = 192.168.122.83 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_port = 3260 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_protocol = iscsi {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.trace_flags = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.unique_fqdn_network = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.use_chap_auth = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_backend_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_clear = zero {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_clear_ionice = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_clear_size = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_reports.file_event_handler = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_reports.log_dir = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.backend_host = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.chap_password = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.chap_username = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_client_cert = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.extra_capabilities = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.filter_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.goodness_function = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iscsi_iotype = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iser_helper = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iser_ip_address = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iser_port = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.lvm_share_target = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.lvm_type = auto {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.num_shell_tries = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.replication_device = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.report_discard_supported = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.reserved_percentage = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.scst_target_driver = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.storage_protocol = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_helper = lioadm {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_ip_address = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_port = 3260 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.trace_flags = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.use_chap_auth = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_clear = zero {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_clear_size = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] lvmdriver-1.volumes_dir = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.164s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_notifications.driver = [] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_notifications.retry = -1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] key_manager.fixed_key = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.barbican_api_version = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.barbican_endpoint = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.barbican_endpoint_type = public {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.barbican_region_name = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.cafile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.collect_timing = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.number_of_retries = 60 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.retry_delay = 1 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.send_service_user_token = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.split_loggers = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.verify_ssl = True {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican.verify_ssl_path = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.auth_section = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.auth_type = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.cafile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.certfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.collect_timing = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.insecure = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.keyfile = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.split_loggers = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] barbican_service_user.timeout = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.approle_role_id = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.approle_secret_id = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.kv_mountpoint = secret {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.kv_path = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.kv_version = 2 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.namespace = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.root_token_id = **** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.ssl_ca_crt_file = None {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.timeout = 60.0 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.use_ssl = False {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:00:57 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] ******************************************************************************** {{(pid=76545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.106s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:00:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:57 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 21:00:57 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:00:59 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Sep 25 21:00:59 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.988s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:00:59 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:00:59 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:00:59 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:01 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.966s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:01:01 devstack cinder-volume[76676]: INFO cinder.brick.local_dev.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 21:01:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:02 devstack sudo[76951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:02 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:03 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.951s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:03 devstack cinder-volume[76676]: DEBUG cinder.brick.local_dev.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76676) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 25 21:01:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:03 devstack sudo[77041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:04 devstack sudo[77041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:06 devstack cinder-volume[76545]: DEBUG dbcounter [-] [76545] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76545) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:01:07 devstack sudo[77041]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:07 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.403s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:07 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:07 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.172s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:07 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:07 devstack sudo[77243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:07 devstack sudo[77243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:09 devstack sudo[77243]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:09 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.993s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:09 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:09 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:09 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:09 devstack sudo[77281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 21:01:09 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:11 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:11 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.091s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:11 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:12 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:12 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:14 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:14 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.709s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:14 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:14 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:14 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:16 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.437s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:17 devstack sudo[77377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:17 devstack sudo[77377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:19 devstack sudo[77377]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.685s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:19 devstack sudo[77383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:19 devstack sudo[77383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:21 devstack sudo[77383]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.053s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.102s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:22 devstack sudo[77389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:22 devstack sudo[77389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:24 devstack sudo[77389]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:24 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.105s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:24 devstack cinder-volume[76676]: INFO cinder.volume.drivers.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 21:01:24 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:24 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.134s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:24 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:24 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:24 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:26 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:26 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.001s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:26 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:01:26 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:26 devstack sudo[77596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:26 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:28 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:28 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.997s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:28 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:28 devstack sudo[77681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:28 devstack sudo[77681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:30 devstack sudo[77681]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:30 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:30 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:30 devstack sudo[77687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:30 devstack sudo[77687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:32 devstack sudo[77687]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:32 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.842s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:32 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:32 devstack sudo[77690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:32 devstack sudo[77690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:34 devstack sudo[77690]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.880s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:34 devstack cinder-volume[76676]: INFO cinder.volume.driver [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG cinder.volume.driver [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writer thread running {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG cinder.db.sqlalchemy.api [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Building query based on filter {{(pid=76676) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG cinder.image.image_utils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1269}} Sep 25 21:01:34 devstack cinder-volume[76676]: INFO cinder.keymgr.migration [None req-5b4a7eca-9683-45db-8e07-ff35b6a46c8f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:01:34 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:34 devstack sudo[77704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:34 devstack sudo[77704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:36 devstack sudo[77704]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:36 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.872s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:36 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:36 devstack sudo[77761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:36 devstack sudo[77761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:38 devstack sudo[77761]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:38 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.917s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:38 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:38 devstack sudo[77850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:38 devstack sudo[77850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:40 devstack sudo[77850]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:40 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.945s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:40 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:40 devstack sudo[77854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:40 devstack sudo[77854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:42 devstack sudo[77854]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.806s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:01:42 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Driver initialization completed successfully. Sep 25 21:01:42 devstack cinder-volume[76676]: INFO cinder.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Initiating service 2 cleanup Sep 25 21:01:42 devstack cinder-volume[76676]: INFO cinder.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Service 2 cleanup completed. Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG cinder.service [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Creating RPC server for service cinder-volume {{(pid=76676) start /opt/stack/cinder/cinder/service.py:239}} Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG cinder.service [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76676) start /opt/stack/cinder/cinder/service.py:245}} Sep 25 21:01:42 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:01:42 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:42 devstack sudo[77857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:42 devstack sudo[77857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:44 devstack sudo[77857]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:44 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.808s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:44 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:44 devstack sudo[77865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:44 devstack sudo[77865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:46 devstack sudo[77865]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:46 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.931s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:46 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:46 devstack sudo[77868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:01:46 devstack sudo[77868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:48 devstack sudo[77868]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:48 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.343s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:48 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:48 devstack sudo[77876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:48 devstack sudo[77876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:50 devstack sudo[77876]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:50 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.814s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:50 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-ca1d1f20-a72a-49c9-9903-d986d9866640 None None] Driver post RPC initialization completed successfully. Sep 25 21:01:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:01:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:01:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:56 devstack sudo[77885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:01:56 devstack sudo[77885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:01:58 devstack sudo[77885]: pam_unix(sudo:session): session closed for user root Sep 25 21:01:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.903s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:01:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:01:58 devstack sudo[77901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:01:58 devstack sudo[77901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:02:00 devstack sudo[77901]: pam_unix(sudo:session): session closed for user root Sep 25 21:02:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.819s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:02:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:02:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:02:00 devstack sudo[77934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:02:00 devstack sudo[77934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:02:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:02:03 devstack sudo[77934]: pam_unix(sudo:session): session closed for user root Sep 25 21:02:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.675s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:02:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:02:03 devstack sudo[78184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:02:03 devstack sudo[78184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:02:05 devstack sudo[78184]: pam_unix(sudo:session): session closed for user root Sep 25 21:02:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.928s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:02:05 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:02:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:02:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:02:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:02:56 devstack sudo[79258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:02:56 devstack sudo[79258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:02:58 devstack sudo[79258]: pam_unix(sudo:session): session closed for user root Sep 25 21:02:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.950s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:02:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:02:58 devstack sudo[79264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:02:58 devstack sudo[79264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:03:00 devstack sudo[79264]: pam_unix(sudo:session): session closed for user root Sep 25 21:03:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.843s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:03:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:03:00 devstack sudo[79269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:03:00 devstack sudo[79269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:03:02 devstack sudo[79269]: pam_unix(sudo:session): session closed for user root Sep 25 21:03:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.813s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:03:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:03:02 devstack sudo[79275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:03:02 devstack sudo[79275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:03:04 devstack sudo[79275]: pam_unix(sudo:session): session closed for user root Sep 25 21:03:04 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.735s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:03:04 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:03:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:03:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:03:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:03:56 devstack sudo[79992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:03:56 devstack sudo[79992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:03:58 devstack sudo[79992]: pam_unix(sudo:session): session closed for user root Sep 25 21:03:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:03:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:03:58 devstack sudo[80023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:03:58 devstack sudo[80023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:04:00 devstack sudo[80023]: pam_unix(sudo:session): session closed for user root Sep 25 21:04:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.937s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:04:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:04:00 devstack sudo[80156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:04:00 devstack sudo[80156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:04:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:04:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:04:02 devstack sudo[80156]: pam_unix(sudo:session): session closed for user root Sep 25 21:04:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.053s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:04:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:04:02 devstack sudo[80228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:04:02 devstack sudo[80228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:04:04 devstack sudo[80228]: pam_unix(sudo:session): session closed for user root Sep 25 21:04:04 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.937s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:04:04 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:04:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:04:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:04:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:04:56 devstack sudo[82776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:04:56 devstack sudo[82776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:04:58 devstack sudo[82776]: pam_unix(sudo:session): session closed for user root Sep 25 21:04:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.756s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:04:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:04:58 devstack sudo[82779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:04:58 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:05:00 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root Sep 25 21:05:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.803s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:05:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:05:00 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:05:00 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:05:02 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Sep 25 21:05:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.725s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:05:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:05:02 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:05:02 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:05:03 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Sep 25 21:05:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.675s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:05:03 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:05:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:05:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:05:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:05:56 devstack sudo[83078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:05:56 devstack sudo[83078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:05:58 devstack sudo[83078]: pam_unix(sudo:session): session closed for user root Sep 25 21:05:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.819s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:05:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:05:58 devstack sudo[83081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:05:58 devstack sudo[83081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:06:00 devstack sudo[83081]: pam_unix(sudo:session): session closed for user root Sep 25 21:06:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.753s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:06:00 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:06:00 devstack sudo[83085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:06:00 devstack sudo[83085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:06:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:06:00 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:06:02 devstack sudo[83085]: pam_unix(sudo:session): session closed for user root Sep 25 21:06:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.741s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:06:02 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:06:02 devstack sudo[83092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:06:02 devstack sudo[83092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:06:03 devstack sudo[83092]: pam_unix(sudo:session): session closed for user root Sep 25 21:06:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.769s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:06:03 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:06:56 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:06:56 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 25 21:06:56 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:06:56 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:06:56 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:06:58 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Sep 25 21:06:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.042s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:06:58 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:06:58 devstack sudo[83848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:06:58 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:07:00 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root Sep 25 21:07:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.151s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:01 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:01 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:07:01 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:07:03 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Sep 25 21:07:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.800s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:03 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:04 devstack sudo[83930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:07:04 devstack sudo[83930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:07:06 devstack sudo[83930]: pam_unix(sudo:session): session closed for user root Sep 25 21:07:06 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.390s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:06 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-22d621cf-421a-4093-add2-b0799f91c371 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:07:10 devstack cinder-volume[76545]: INFO oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Caught SIGTERM, stopping children Sep 25 21:07:10 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Acquiring lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 25 21:07:10 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Acquired lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 25 21:07:10 devstack cinder-volume[76545]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Releasing lock "singleton_lock" {{(pid=76545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 25 21:07:10 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Stop services. {{(pid=76545) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 25 21:07:10 devstack cinder-volume[76545]: DEBUG oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Killing children. {{(pid=76545) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 25 21:07:10 devstack cinder-volume[76545]: INFO oslo_service.backend._eventlet.service [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Waiting on 1 children to exit Sep 25 21:07:15 devstack cinder-volume[76676]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 21:07:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Acquiring lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 25 21:07:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Acquired lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 25 21:07:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Releasing lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 25 21:07:17 devstack cinder-volume[76676]: WARNING amqp [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:07:17 devstack cinder-volume[76676]: WARNING amqp [None req-7ebbd52a-a560-491b-82d0-0d8e02782b44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:07:31 devstack cinder-volume[84081]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84081) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 25 21:07:31 devstack cinder-volume[84081]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84081) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 25 21:07:31 devstack cinder-volume[84081]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84081) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 25 21:07:33 devstack cinder-volume[84081]: INFO dbcounter [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Registered counter for database cinder Sep 25 21:07:33 devstack cinder-volume[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:07:33 devstack cinder-volume[84081]: DEBUG dbcounter [-] [84081] Writer thread running {{(pid=84081) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 25 21:07:33 devstack cinder-volume[84081]: INFO cinder.rpc [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 21:07:34 devstack cinder-volume[84081]: INFO cinder.rpc [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:07:34 devstack cinder-volume[84081]: INFO cinder.volume.manager [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Determined volume DB was empty at startup. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG cinder.volume.manager [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84081) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 25 21:07:34 devstack cinder-volume[84081]: INFO cinder.volume.manager [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 21:07:34 devstack cinder-volume[84081]: WARNING stevedore.named [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:07:34 devstack cinder-volume[84081]: WARNING castellan.key_manager [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:07:34 devstack cinder-volume[84081]: WARNING cinder.keymgr.conf_key_mgr [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:07:34 devstack cinder-volume[84081]: INFO cinder.volume.manager [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:07:34 devstack cinder-volume[84081]: INFO oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Starting 1 workers Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Started child 84334 {{(pid=84081) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Full set of CONF: {{(pid=84081) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] ******************************************************************************** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Configuration options gathered from: {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] ================================================================================ {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] allow_availability_zone_fallback = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] allow_compression_on_image_upload = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] allowed_direct_url_schemes = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] api_rate_limit = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84334]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] auth_strategy = keystone {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_availability_zone = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_host = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_stats_polling_interval = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backup_api_class = cinder.backup.api.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backup_name_template = backup-%s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backup_use_same_host = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backup_use_temp_snapshot = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] chap_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] chap_username = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_internal_tenant_project_id = f871f7fb00d14c0f86c53ce69f47d186 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_internal_tenant_user_id = 0345032cc1c64d90bc6a54ab08ac5fe9 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cluster = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] compression_format = gzip {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] compute_api_class = cinder.compute.nova.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] config_dir = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] config_source = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] control_exchange = openstack {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] debug = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] default_availability_zone = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] default_group_type = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] default_volume_type = QuobyteHD {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_client_cert = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_client_cert_key = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_data_namespace = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_ssl_cert_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] driver_use_ssl = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] enable_new_services = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] enable_unsupported_driver = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] enabled_backends = ['QuobyteHD'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] filter_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_api_insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_api_servers = ['http://192.168.122.83/image'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_api_ssl_compression = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_ca_certificates_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_catalog_info = image:glance:publicURL {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_num_retries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance_request_timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] goodness_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] graceful_shutdown_timeout = 5 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] group_api_class = cinder.group.api.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] host = devstack {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_compress_on_upload = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_conversion_address_space_limit = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_conversion_cpu_limit = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_conversion_disable = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_volume_cache_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] init_host_max_objects_retrieval = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] instance_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iscsi_iotype = fileio {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iscsi_target_flags = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iscsi_write_cache = on {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iser_helper = tgtadm {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iser_ip_address = 192.168.122.83 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iser_port = 3260 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_color = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_config_append = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_dir = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_options = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_rotate_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_rotate_interval_type = days {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] log_rotation_type = none {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] max_age = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] max_logfile_count = 30 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] max_logfile_size_mb = 200 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] message_reap_interval = 86400 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] message_ttl = 2592000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] migration_create_volume_timeout_secs = 300 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] monkey_patch = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] monkey_patch_modules = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] my_ip = 192.168.122.83 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] no_snapshot_gb_quota = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] num_shell_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] nvmet_ns_id = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] nvmet_port_id = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_max_limit = 1000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_ext_list = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_listen_port = 8776 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_use_ssl = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] osapi_volume_workers = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] per_volume_size_limit = -1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] periodic_fuzzy_delay = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] periodic_interval = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] public_endpoint = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] publish_errors = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_backup_gigabytes = 1000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_backups = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_gigabytes = 1000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_groups = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_snapshots = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] quota_volumes = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] rate_limit_burst = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] rate_limit_except_level = CRITICAL {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] rate_limit_interval = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] reinit_driver_count = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] replication_device = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] report_discard_supported = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] report_interval = 120 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] reservation_clean_interval = 86400 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] reservation_expire = 86400 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] reserved_image_namespaces = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] reserved_percentage = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] rpc_response_timeout = 120 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] run_external_periodic_tasks = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] scst_target_driver = iscsi {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] scst_target_iqn_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_down_time = 720 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] shell_completion = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] snapshot_name_template = snapshot-%s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] split_loggers = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] state_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] storage_availability_zone = nova {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] storage_protocol = iSCSI {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] syslog_log_facility = LOG_USER {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_helper = lioadm {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_ip_address = 192.168.122.83 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_port = 3260 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_protocol = iscsi {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] trace_flags = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] transport_url = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] until_refresh = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_chap_auth = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_default_quota_class = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_journal = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_json = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_stderr = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] use_syslog = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] verify_glance_signatures = enabled {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_api_class = cinder.volume.api.API {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_backend_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_clear = zero {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_clear_ionice = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_clear_size = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_name_template = volume-%s {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_service_inithost_offload = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volume_usage_audit_period = month {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] watch_log_file = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] zoning_mode = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_concurrency.disable_process_locking = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.admin_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.admin_token = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.admin_user = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_port = 35357 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_protocol = https {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_section = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_type = password {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_uri = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.auth_version = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.cache = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.identity_uri = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.include_service_catalog = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.interface = public {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_password = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcache_username = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.region_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.service_type = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.backend = dogpile.cache.null {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.backend_argument = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.backend_expiration_time = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.config_prefix = cache.oslo {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.dead_timeout = 60.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.debug_cache_backend = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.enable_retry_client = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.enable_socket_keepalive = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.enforce_fips_mode = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.expiration_time = 600 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.hashclient_retry_attempts = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.hashclient_retry_delay = 1.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_dead_retry = 300 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_sasl_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_socket_timeout = 1.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.memcache_username = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.proxies = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_db = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Starting volume driver QuobyteDriver (1.1.13) Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_server = localhost:6379 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_socket_timeout = 1.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.redis_username = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.retry_attempts = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84334) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.retry_delay = 0.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.socket_keepalive_count = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.socket_keepalive_idle = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.socket_keepalive_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.tls_allowed_ciphers = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.tls_cafile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.tls_certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.tls_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cache.tls_keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] coordination.backend_url = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.asyncio_connection = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.asyncio_slave_connection = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.backend = sqlalchemy {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.connection = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.connection_debug = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.connection_parameters = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.connection_recycle_time = 3600 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.connection_trace = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.db_inc_retry_interval = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.db_max_retries = 20 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.db_max_retry_interval = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.db_retry_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.max_overflow = 50 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.max_pool_size = 5 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.max_retries = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.mysql_wsrep_sync_wait = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.pool_timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.retry_interval = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.slave_connection = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.sqlite_synchronous = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] database.use_db_reconnect = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.connection_string = messaging:// {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.es_doc_type = notification {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.es_scroll_size = 10000 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.es_scroll_time = 2m {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.filter_error_trace = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.hmac_keys = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.sentinel_service_name = mymaster {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.socket_timeout = 0.1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.trace_requests = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler.trace_sqlalchemy = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler_jaeger.process_tags = {} {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler_jaeger.service_name_prefix = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] profiler_otlp.service_name_prefix = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.enforce_new_defaults = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: WARNING oslo_config.cfg [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.enforce_scope = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.policy_default_rule = default {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.policy_file = policy.yaml {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.group = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.helper_command = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] privsep_osbrick.user = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.group = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.helper_command = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] cinder_sys_admin.user = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.auth_section = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.auth_type = password {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.collect_timing = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.send_service_user_token = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.split_loggers = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] service_user.timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.auth_section = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.auth_type = password {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.collect_timing = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.split_loggers = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] glance.timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.backend_availability_zone = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.chap_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.chap_username = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_client_cert = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_client_cert_key = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_data_namespace = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.driver_use_ssl = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.extra_capabilities = {} {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.filter_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.goodness_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iscsi_iotype = fileio {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iscsi_target_flags = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iscsi_write_cache = on {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iser_helper = tgtadm {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iser_ip_address = 192.168.122.83 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iser_port = 3260 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_host = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_login = admin {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_mount_options = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_private_key = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_share_path = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.num_shell_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.quobyte_volume_url = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.replication_device = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.report_discard_supported = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.reserved_percentage = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_helper = tgtadm {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_ip_address = 192.168.122.83 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_port = 3260 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_protocol = iscsi {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.trace_flags = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.unique_fqdn_network = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.use_chap_auth = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_backend_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_clear = zero {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_clear_ionice = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_clear_size = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_reports.file_event_handler = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_reports.log_dir = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.backend_availability_zone = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.backend_host = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.chap_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.chap_username = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.chiscsi_conf = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_client_cert = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_data_namespace = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.driver_use_ssl = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.extra_capabilities = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.filter_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.goodness_function = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iscsi_iotype = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iser_helper = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iser_ip_address = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iser_port = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.iser_target_prefix = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_host = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_login = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_mount_options = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_password = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_private_key = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_share_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_ssh_port = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.num_shell_tries = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.nvmet_port_id = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.replication_device = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.report_discard_supported = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.reserved_percentage = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.scst_target_driver = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.storage_protocol = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_helper = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_ip_address = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_port = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_prefix = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_protocol = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.trace_flags = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.use_chap_auth = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_clear = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_clear_size = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] QuobyteHD.volumes_dir = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_notifications.driver = [] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_notifications.retry = -1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] key_manager.fixed_key = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.barbican_api_version = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.barbican_endpoint = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.barbican_endpoint_type = public {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.barbican_region_name = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.cafile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.collect_timing = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.number_of_retries = 60 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.retry_delay = 1 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.send_service_user_token = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.split_loggers = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.verify_ssl = True {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican.verify_ssl_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.auth_section = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.auth_type = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.cafile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.certfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.collect_timing = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.insecure = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.keyfile = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.split_loggers = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] barbican_service_user.timeout = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84334) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.approle_role_id = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84334]: INFO cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.approle_secret_id = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.kv_mountpoint = secret {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.kv_path = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.kv_version = 2 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.namespace = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.root_token_id = **** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.ssl_ca_crt_file = None {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.timeout = 60.0 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.use_ssl = False {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 25 21:07:34 devstack cinder-volume[84081]: DEBUG oslo_service.backend._eventlet.service [None req-b17d6fcd-3047-4e97-a314-ac5b7ebaac84 None None] ******************************************************************************** {{(pid=84081) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 25 21:07:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Running cmd (subprocess): mount.quobyte {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:35 devstack quobyte-client[84347]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 21:07:35 devstack quobyte-client[84347]: Invalid parameters found, error: missing mount point. Sep 25 21:07:35 devstack quobyte-client[84347]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 21:07:35 devstack quobyte-client[84347]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 25 21:07:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] CMD "mount.quobyte" returned: 1 in 0.343s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:07:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:07:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:07:35 devstack cinder-volume[84334]: INFO cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Mounting volume: 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 ... Sep 25 21:07:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 -c /etc/quobyte/client-cinder.cfg {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:35 devstack quobyte-client[84348]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 25 21:07:35 devstack quobyte-client[84348]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 21:07:35 devstack quobyte-client[84348]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30' to display the log. Sep 25 21:07:35 devstack quobyte-client[84349]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 25 21:07:35 devstack quobyte-client[84349]: mount.quobyte 3.25 (4fbbd59204) Sep 25 21:07:35 devstack quobyte-client[84349]: Client UUID: xNNlYL71-o0Ng-SXgt-w3xr-iFDiHPJ3Bx5j Sep 25 21:07:35 devstack quobyte-client[84349]: Registry: osci01.corp.quobyte.com:7861 Sep 25 21:07:35 devstack quobyte-client[84349]: Volume: cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:07:35 devstack quobyte-client[84349]: FUSE version: 316 Sep 25 21:07:35 devstack quobyte-client[84349]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 25 21:07:35 devstack quobyte-client[84349]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 25 21:07:35 devstack quobyte-client[84349]: Setting total object cache size to 3352297472 bytes Sep 25 21:07:35 devstack quobyte-client[84349]: Using FUSE low-level API Sep 25 21:07:35 devstack quobyte-client[84349]: Caching of uid/gid to user/group name mappings is enabled Sep 25 21:07:35 devstack quobyte-client[84349]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 25 21:07:35 devstack quobyte-client[84349]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 25 21:07:35 devstack quobyte-client[84349]: HTTP server started on port 55000 Sep 25 21:07:35 devstack quobyte-client[84349]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 25 21:07:35 devstack quobyte-client[84349]: Mount point /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 established Sep 25 21:07:35 devstack quobyte-client[84349]: TimeSync is running and remote sync every 60 seconds Sep 25 21:07:35 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:35 devstack quobyte-client[84349]: Ignored time synchronization message because time source took too long to respond (59 ms) Sep 25 21:07:35 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:35 devstack quobyte-client[84349]: Opening volume cinder-vol-f590f695-71b5-403d-b04b-88616e755002 (e2c4ca12-45b4-4111-a93e-91d8f6f83660) Sep 25 21:07:35 devstack quobyte-client[84349]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 25 21:07:35 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:35 devstack quobyte-client[84349]: Changed metadata cache configuration for volume e2c4ca12-45b4-4111-a93e-91d8f6f83660 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false Sep 25 21:07:35 devstack quobyte-client[84349]: Failed to invalidate inode: 38: Function not implemented Sep 25 21:07:35 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:36 devstack quobyte-client[84349]: Automatic minidump upload enabled by global system configuration Sep 25 21:07:36 devstack quobyte-client[84349]: Announcing HTTP status server address 172.24.4.1 Sep 25 21:07:36 devstack quobyte-client[84349]: Registered as service (uuid xNNlYL71-o0Ng-SXgt-w3xr-iFDiHPJ3Bx5j) Sep 25 21:07:36 devstack quobyte-client[84349]: Quobyte Client running as pid 84349 Sep 25 21:07:36 devstack quobyte-client[84349]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 25 21:07:36 devstack quobyte-client[84349]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.636s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:36 devstack cinder-volume[84334]: INFO cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Mounting volume: 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 succeeded Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.694s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:36 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:36 devstack cinder-volume[84334]: INFO cinder.volume.driver [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Driver hasn't implemented _init_vendor_properties() Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.volume.driver [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84334) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_db.sqlalchemy.engines [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writer thread running {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.db.sqlalchemy.api [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Building query based on filter {{(pid=84334) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84334) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1269}} Sep 25 21:07:36 devstack cinder-volume[84334]: INFO cinder.keymgr.migration [None req-1deb3b94-74dc-491b-a014-f54425527153 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.079s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:36 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:07:37 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Driver initialization completed successfully. Sep 25 21:07:37 devstack cinder-volume[84334]: INFO cinder.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Initiating service 3 cleanup Sep 25 21:07:37 devstack cinder-volume[84334]: INFO cinder.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Service 3 cleanup completed. Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG cinder.service [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Creating RPC server for service cinder-volume {{(pid=84334) start /opt/stack/cinder/cinder/service.py:239}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG cinder.service [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84334) start /opt/stack/cinder/cinder/service.py:245}} Sep 25 21:07:37 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 25 21:07:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:07:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:07:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.152s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:07:37 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4a70d4d5-85e2-4021-b74e-45691eb20e5c None None] Driver post RPC initialization completed successfully. Sep 25 21:07:38 devstack quobyte-client[84349]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 25 21:07:44 devstack cinder-volume[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84081) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:07:47 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:07:47 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:08:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (6d99e898-fb25-4ab0-b55e-08f4f6a2fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c16e520-f246-44a7-90a1-c86dfa609966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c16e520-f246-44a7-90a1-c86dfa609966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1508711171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb00c8c-610d-4382-8647-66632e619df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:08:34Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0752027-0ac2-40fd-b479-ec0808882697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0752027-0ac2-40fd-b479-ec0808882697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f29ab3-4258-44fb-bd66-1e4344cc1fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:34 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f29ab3-4258-44fb-bd66-1e4344cc1fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5eb00c8c-610d-4382-8647-66632e619df9', 'volume_name': 'volume-5eb00c8c-610d-4382-8647-66632e619df9', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76103483-e2fe-43f1-84d6-fd9b320296d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76103483-e2fe-43f1-84d6-fd9b320296d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff9a40c-35a6-4bb4-82e3-eea740c226e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:35 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Volume 5eb00c8c-610d-4382-8647-66632e619df9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5eb00c8c-610d-4382-8647-66632e619df9', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Cloning 5eb00c8c-610d-4382-8647-66632e619df9 from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b at location (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:08:35 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:08:35 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:08:35 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzhdbmd39/privsep.sock'] Sep 25 21:08:35 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzhdbmd39/privsep.sock Sep 25 21:08:35 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:08:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.248s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:08:41 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Sep 25 21:08:41 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Spawned new privsep daemon via rootwrap Sep 25 21:08:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Accepted privsep connection to /tmp/tmpzhdbmd39/privsep.sock {{(pid=84334) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 25 21:08:41 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 21:08:41 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 21:08:41 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 21:08:41 devstack cinder-volume[84334]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84682 Sep 25 21:08:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897d07c-b1f2-4bfe-8dca-d1429489c94c]: (2,) {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1dd17a-cc0b-46d1-806e-f9e5f6eb6d84]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:42 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD Sep 25 21:08:42 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:08:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:08:43 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:08:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Flow 'volume_create_manager' (659b7631-8a4b-4d8d-bff8-4cb67afb49c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:08:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5395e788-97b8-40c9-8c0f-226de37e3d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5395e788-97b8-40c9-8c0f-226de37e3d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-876788037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c6cab4e1a04452a238281ae26c48f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:08:43Z,use_quota=True,user_id='6ba43d59185d4e6babb24d87baaff7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d204cdb-eb0c-40ff-973f-951070ecb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d204cdb-eb0c-40ff-973f-951070ecb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89d77a4-dbdd-45c1-ab18-93a4eadde742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89d77a4-dbdd-45c1-ab18-93a4eadde742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48', 'volume_name': 'volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5c737d-a109-4eda-9a34-d104a29aad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5c737d-a109-4eda-9a34-d104a29aad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d42703-d26d-46aa-9eed-586946b91870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48', 'volume_size': 1} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-876788037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c6cab4e1a04452a238281ae26c48f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:08:43Z,use_quota=True,user_id='6ba43d59185d4e6babb24d87baaff7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Creating volume b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:08:44 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:44 devstack quobyte-client[84349]: System call of process 84700 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:44 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD" returned: 0 in 2.859s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:44 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b is fetched for user 610755e783f248ba8eabec0768fd2e3d. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:08:44 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=2, name=volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 1073741824" returned: 0 in 1.003s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e5332-4561-4ffa-b632-f805e14f5a53]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" returned: 0 in 0.288s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] <== create_volume: return (1400ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:08:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:08:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d42703-d26d-46aa-9eed-586946b91870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708ddbc3-64f0-4ca6-b783-383377d259c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:08:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 (b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48): created successfully Sep 25 21:08:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708ddbc3-64f0-4ca6-b783-383377d259c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:08:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Flow 'volume_create_manager' (659b7631-8a4b-4d8d-bff8-4cb67afb49c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:08:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-87da3fb5-96dc-424a-9142-33c3076c4b3a tempest-VolumesAssistedSnapshotsTest-1248964061 None] Created volume successfully. Sep 25 21:08:46 devstack sudo[85025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD Sep 25 21:08:46 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:08:50 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD" returned: 0 in 4.714s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1508711171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb00c8c-610d-4382-8647-66632e619df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:08:34Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Creating volume 5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:08:50 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:50 devstack quobyte-client[84349]: System call of process 85079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:50 devstack quobyte-client[84349]: System call of process 85079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:50 devstack quobyte-client[84349]: System call of process 85079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:50 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=3, name=volume-5eb00c8c-610d-4382-8647-66632e619df9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 1073741824" returned: 0 in 0.562s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 0.184s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Attempting download of 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 5eb00c8c-610d-4382-8647-66632e619df9. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd724889-1463-4b62-bcb7-e85dce54d4b4]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_21cyh9mh {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_21cyh9mh" returned: 0 in 0.972s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_21cyh9mh {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_21cyh9mh" returned: 1 in 1.155s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_21cyh9mh' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:08:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2330f7-f594-4dcc-b422-e4de574fc604]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD" returned: 0 in 1.525s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:55 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b was qcow2, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:08:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:56 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:08:56 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=3, name=volume-5eb00c8c-610d-4382-8647-66632e619df9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:08:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 1.904s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:57 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_lvzsjrn7devstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:08:57 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Converted 112.00 MB image at 57.71 MB/s Sep 25 21:08:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:08:58 devstack quobyte-client[84349]: System call of process 85110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:58 devstack quobyte-client[84349]: System call of process 85110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:08:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 1G" returned: 0 in 0.675s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:08:58 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917babd-43c9-4b9c-baa3-6a1dbc3c6f87]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:08:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:00 devstack quobyte-client[84349]: System call of process 85118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:00 devstack quobyte-client[84349]: System call of process 85118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 1.281s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:01 devstack quobyte-client[84349]: System call of process 85123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:01 devstack quobyte-client[84349]: System call of process 85123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:01 devstack quobyte-client[84349]: System call of process 85123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:01 devstack quobyte-client[84349]: System call of process 85123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 1 in 1.051s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:09:01 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Downloaded image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 5eb00c8c-610d-4382-8647-66632e619df9 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:09:01 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b for user 610755e783f248ba8eabec0768fd2e3d is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:09:01 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Marking volume 5eb00c8c-610d-4382-8647-66632e619df9 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Copying metadata from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b to 5eb00c8c-610d-4382-8647-66632e619df9. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Creating volume glance metadata for volume 5eb00c8c-610d-4382-8647-66632e619df9 backed by image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff9a40c-35a6-4bb4-82e3-eea740c226e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb00c8c-610d-4382-8647-66632e619df9', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356678d1-b5d6-487d-b900-364c62c5f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Volume volume-5eb00c8c-610d-4382-8647-66632e619df9 (5eb00c8c-610d-4382-8647-66632e619df9): created successfully Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356678d1-b5d6-487d-b900-364c62c5f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (6d99e898-fb25-4ab0-b55e-08f4f6a2fde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:09:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ca49fdc4-968f-43a3-a698-c1ac3320c977 tempest-TaggedBootDevicesTest-131600716 None] Created volume successfully. Sep 25 21:09:03 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:09:03 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:09:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (8652c885-3b8d-4c8f-813f-d311ed05aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:09:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a846fa-248c-4979-9454-d1f73039e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a846fa-248c-4979-9454-d1f73039e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-338620756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88623740-bc33-411b-8248-713351cd51d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:09:04Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb80661-5291-4d4b-9ecc-849afd11e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb80661-5291-4d4b-9ecc-849afd11e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1382b5d4-b99e-4799-b41a-efcc8959e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1382b5d4-b99e-4799-b41a-efcc8959e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88623740-bc33-411b-8248-713351cd51d2', 'volume_name': 'volume-88623740-bc33-411b-8248-713351cd51d2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c80713-b6a2-404b-8aae-5394399c3b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c80713-b6a2-404b-8aae-5394399c3b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0149f2-708f-4335-81c2-3a677fdceabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:04 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Volume 88623740-bc33-411b-8248-713351cd51d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88623740-bc33-411b-8248-713351cd51d2', 'volume_size': 1} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-338620756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88623740-bc33-411b-8248-713351cd51d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:09:04Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Creating volume 88623740-bc33-411b-8248-713351cd51d2 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:09:04 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:04 devstack quobyte-client[84349]: System call of process 85128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:09:04 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=4, name=volume-88623740-bc33-411b-8248-713351cd51d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 1073741824" returned: 0 in 0.493s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2" returned: 0 in 0.231s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] <== create_volume: return (813ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:09:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:09:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0149f2-708f-4335-81c2-3a677fdceabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88623740-bc33-411b-8248-713351cd51d2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c459dbcb-e10e-4308-9dda-14095e6dcafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Volume volume-88623740-bc33-411b-8248-713351cd51d2 (88623740-bc33-411b-8248-713351cd51d2): created successfully Sep 25 21:09:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c459dbcb-e10e-4308-9dda-14095e6dcafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (8652c885-3b8d-4c8f-813f-d311ed05aeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:09:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bf1a0bf7-370a-4ab4-8591-bb8d92faf87b tempest-TaggedBootDevicesTest-131600716 None] Created volume successfully. Sep 25 21:09:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (0e3c7bff-8eb0-45bb-8307-90d2efa6e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c82767-40b9-4305-b0a6-05b02e86af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c82767-40b9-4305-b0a6-05b02e86af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-195089441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8584953-1ecf-498a-8349-c304e3d6df41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:09:08Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902a804a-0cf2-40b2-bb76-932c7b94c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902a804a-0cf2-40b2-bb76-932c7b94c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bea4342-7988-45ea-ae72-6d22fffc0897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bea4342-7988-45ea-ae72-6d22fffc0897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8584953-1ecf-498a-8349-c304e3d6df41', 'volume_name': 'volume-f8584953-1ecf-498a-8349-c304e3d6df41', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f7d7c6-c53c-4d63-8ee4-583415ebf95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f7d7c6-c53c-4d63-8ee4-583415ebf95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cab6ac2-0d81-4ca9-b8e0-3f227a77a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Volume f8584953-1ecf-498a-8349-c304e3d6df41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8584953-1ecf-498a-8349-c304e3d6df41', 'volume_size': 1} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:09:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-195089441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8584953-1ecf-498a-8349-c304e3d6df41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751d82e51b14304879cd4e58bdba33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:09:08Z,use_quota=True,user_id='610755e783f248ba8eabec0768fd2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Creating volume f8584953-1ecf-498a-8349-c304e3d6df41 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:09:09 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:09:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:09 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=5, name=volume-f8584953-1ecf-498a-8349-c304e3d6df41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:09:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 1073741824" returned: 0 in 0.896s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41" returned: 0 in 0.546s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] <== create_volume: return (1955ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:09:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:09:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cab6ac2-0d81-4ca9-b8e0-3f227a77a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8584953-1ecf-498a-8349-c304e3d6df41', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7e04cb-4394-4be1-8782-b21d373e4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:09:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Volume volume-f8584953-1ecf-498a-8349-c304e3d6df41 (f8584953-1ecf-498a-8349-c304e3d6df41): created successfully Sep 25 21:09:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7e04cb-4394-4be1-8782-b21d373e4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:09:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Flow 'volume_create_manager' (0e3c7bff-8eb0-45bb-8307-90d2efa6e495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:09:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-44bca69b-2e30-4974-9b3a-36ed23e400fe tempest-TaggedBootDevicesTest-131600716 None] Created volume successfully. Sep 25 21:09:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:09:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=12,cinder:DELETE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:09:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:09:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.171s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:09:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:09:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:10:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:01 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:10:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Flow 'volume_create_manager' (d595d1f1-cd09-4170-82dd-3aaadcb20199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:10:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a71e51-01f1-46ce-a8cc-72485ecad7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a71e51-01f1-46ce-a8cc-72485ecad7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1661971654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836ae116-7c65-42a1-aaf0-2d3d47ec029b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8640412e3a5041e29ea386ced6aae3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:10:00Z,use_quota=True,user_id='0095b7f34ba94915a64a94b1c6b328b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3856807a-e89f-4595-8e59-ea85fb66b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3856807a-e89f-4595-8e59-ea85fb66b932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2df1ed-09ba-418a-906a-0adf2097ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2df1ed-09ba-418a-906a-0adf2097ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836ae116-7c65-42a1-aaf0-2d3d47ec029b', 'volume_name': 'volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cec335-f4f8-418e-859a-d3d85794b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cec335-f4f8-418e-859a-d3d85794b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307f1d4d-fa26-4d0f-9e2a-7378d4da954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Volume 836ae116-7c65-42a1-aaf0-2d3d47ec029b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b', 'volume_size': 1} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1661971654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836ae116-7c65-42a1-aaf0-2d3d47ec029b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8640412e3a5041e29ea386ced6aae3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:10:00Z,use_quota=True,user_id='0095b7f34ba94915a64a94b1c6b328b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Creating volume 836ae116-7c65-42a1-aaf0-2d3d47ec029b {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:10:02 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:10:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:02 devstack quobyte-client[84349]: System call of process 85549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:02 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=6, name=volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:10:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b 1073741824" returned: 0 in 1.348s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b" returned: 0 in 0.459s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] <== create_volume: return (2112ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:10:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307f1d4d-fa26-4d0f-9e2a-7378d4da954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4d6fd4-dbee-49ce-97bb-f48f3c032de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Volume volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b (836ae116-7c65-42a1-aaf0-2d3d47ec029b): created successfully Sep 25 21:10:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4d6fd4-dbee-49ce-97bb-f48f3c032de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Flow 'volume_create_manager' (d595d1f1-cd09-4170-82dd-3aaadcb20199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:10:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-71ab3e1d-6840-4d65-b870-2ae58bd39724 tempest-ServersNegativeTestJSON-1314143011 None] Created volume successfully. Sep 25 21:10:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Flow 'volume_create_manager' (9260dbe0-f18b-4b73-b181-462cb4825325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de47d72c-b242-4176-83ff-aec92d28c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de47d72c-b242-4176-83ff-aec92d28c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-720207780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8640412e3a5041e29ea386ced6aae3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:10:11Z,use_quota=True,user_id='0095b7f34ba94915a64a94b1c6b328b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cc8864-dd87-4404-8308-19bae1c5591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cc8864-dd87-4404-8308-19bae1c5591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7433e6eb-2199-40e0-b5e2-d066a01d9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7433e6eb-2199-40e0-b5e2-d066a01d9139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb', 'volume_name': 'volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d76dbc-8016-4442-8e0e-39f32b493c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d76dbc-8016-4442-8e0e-39f32b493c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b00c3c-5586-495d-bd07-2cf00e6aa007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:11 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Volume 1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb', 'volume_size': 1} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-720207780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8640412e3a5041e29ea386ced6aae3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:10:11Z,use_quota=True,user_id='0095b7f34ba94915a64a94b1c6b328b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Creating volume 1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:10:11 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:10:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:12 devstack quobyte-client[84349]: System call of process 85575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:12 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=7, name=volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:10:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb 1073741824" returned: 0 in 0.936s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" returned: 0 in 0.476s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] <== create_volume: return (1690ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:10:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b00c3c-5586-495d-bd07-2cf00e6aa007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68469467-db1e-452f-b138-ee06868546e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:10:14 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Volume volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb (1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb): created successfully Sep 25 21:10:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68469467-db1e-452f-b138-ee06868546e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:10:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Flow 'volume_create_manager' (9260dbe0-f18b-4b73-b181-462cb4825325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:10:14 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8f935c14-d9fc-44fd-b570-968e72b96a64 tempest-ServersNegativeTestJSON-1314143011 None] Created volume successfully. Sep 25 21:10:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:15 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05d2cc-4fc1-4a1b-bd5c-5c40d0520436]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:10:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:16 devstack quobyte-client[84349]: System call of process 85590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 1.111s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:17 devstack quobyte-client[84349]: System call of process 85593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:17 devstack quobyte-client[84349]: System call of process 85593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 1 in 0.607s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:10:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-5eb00c8c-610d-4382-8647-66632e619df9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16162a2e-c0a3-4dcb-b70b-634b37a3dfd2', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:10:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-f70aaacf-2a91-40f4-bb9b-7574f0cfd700 tempest-TaggedBootDevicesTest-131600716 None] attachment_update completed successfully. Sep 25 21:10:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "cinder-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:10:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:10:21 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "cinder-quobyte-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:10:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-quobyte-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:10:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f7c84-dd7e-4a58-8817-c47300795350]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:10:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" returned: 0 in 1.025s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" returned: 0 in 0.648s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c72890-6bf8-400f-a3be-88f9662e563c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:10:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-quobyte-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb" released by "delete_volume" :: held 2.212s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:10:24 devstack cinder-volume[84334]: WARNING cinder.quota [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:10:24 devstack cinder-volume[84334]: WARNING cinder.quota [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:10:24 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Created reservations ['96072f6f-56d5-463b-a2c7-6b5111255e25', '3cd413c3-30de-44d3-b451-9a0f45332c0e', 'e743a4cc-7a48-40f3-bf60-799a6417e0b1', '32ec99bf-35bf-452f-974f-f6c949707a80'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:10:24 devstack quobyte-client[84349]: System call of process 85645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:24 devstack quobyte-client[84349]: System call of process 85645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:24 devstack quobyte-client[84349]: System call of process 85645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2" returned: 0 in 1.031s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.169s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-88623740-bc33-411b-8248-713351cd51d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c019e667-81e2-448f-a775-e4b24a5871af', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:10:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "cinder-836ae116-7c65-42a1-aaf0-2d3d47ec029b-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.972s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-836ae116-7c65-42a1-aaf0-2d3d47ec029b-delete_volume" acquired by "delete_volume" :: waited 0.286s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:10:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Deleted volume successfully. Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c00ca73f-84d0-40d8-8664-78319fa2ac22 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-1b52f8fa-1dbb-4ea5-9b7d-5a26f1786ebb-delete_volume" released by "delete_volume" :: held 4.474s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:10:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "cinder-quobyte-836ae116-7c65-42a1-aaf0-2d3d47ec029b" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:10:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-5f4dc414-0fe3-4488-b00e-34785591794c tempest-TaggedBootDevicesTest-131600716 None] attachment_update completed successfully. Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-quobyte-836ae116-7c65-42a1-aaf0-2d3d47ec029b" acquired by "delete_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d463a89-3482-4d16-ad17-f86e18fe9ce0]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:10:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:27 devstack quobyte-client[84349]: System call of process 85652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b" returned: 0 in 0.899s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-836ae116-7c65-42a1-aaf0-2d3d47ec029b" returned: 0 in 0.268s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-quobyte-836ae116-7c65-42a1-aaf0-2d3d47ec029b" released by "delete_volume" :: held 1.427s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Created reservations ['87963314-7ef6-4e79-9b5e-2d1d5867d2cb', 'a4b68a4c-d711-48c6-bdda-9f2cef20cb8a', 'd178de3f-4479-437d-ab1f-54ffaf442c21', '49204726-44b6-4c9c-8495-ebdbc8f56d65'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.308s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:29 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:10:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Deleted volume successfully. Sep 25 21:10:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f9ef9355-f89e-4fd4-867d-d418cdf21c98 tempest-ServersNegativeTestJSON-1314143011 None] Lock "cinder-836ae116-7c65-42a1-aaf0-2d3d47ec029b-delete_volume" released by "delete_volume" :: held 3.787s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:10:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:30 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e64e8a-a19c-4b1c-a496-341757a3f6da]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:10:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:31 devstack quobyte-client[84349]: System call of process 85668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:10:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41" returned: 0 in 0.489s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.560s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-f8584953-1ecf-498a-8349-c304e3d6df41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38aeec11-388b-4597-9e49-af8b0a01b3a5', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:10:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:10:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-6915d721-be9d-4951-bfda-af299d303877 req-b3047de2-7829-4067-bb0e-27c63f4d641e tempest-TaggedBootDevicesTest-131600716 None] attachment_update completed successfully. Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:10:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:10:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.134s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:10:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:10:42 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:10:42 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=19,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:11:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:11:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:11:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[70631371-c814-4a2d-9f2c-1c0fe0681bce]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:11:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:11:08 devstack quobyte-client[84349]: System call of process 86574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:11:08 devstack quobyte-client[84349]: System call of process 86574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:11:08 devstack quobyte-client[84349]: System call of process 86574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:11:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" returned: 0 in 1.539s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:11:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.749s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:11:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3567f4ae-11fe-4a36-bd84-e925ce61ae7f', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:11:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:11:09 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-d91525f3-628f-4b57-bb41-6ae7d4afac7a req-c2b20ad9-011e-4abd-937c-90d5a7ab71a9 tempest-VolumesAssistedSnapshotsTest-1248964061 None] attachment_update completed successfully. Sep 25 21:11:19 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:11:19 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:11:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.081s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:11:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:11:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-2b960bdf-00ef-4e05-b8b2-5f92b36305bd req-9ba28031-4c47-43b5-b109-a1335edbd1eb tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:11:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-2b960bdf-00ef-4e05-b8b2-5f92b36305bd req-9ba28031-4c47-43b5-b109-a1335edbd1eb tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:11:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-2b960bdf-00ef-4e05-b8b2-5f92b36305bd req-9ba28031-4c47-43b5-b109-a1335edbd1eb tempest-VolumesAssistedSnapshotsTest-1248964061 None] Terminate volume connection completed successfully. Sep 25 21:11:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-2b960bdf-00ef-4e05-b8b2-5f92b36305bd req-9ba28031-4c47-43b5-b109-a1335edbd1eb tempest-VolumesAssistedSnapshotsTest-1248964061 None] Deleting attachment 3567f4ae-11fe-4a36-bd84-e925ce61ae7f. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "cinder-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "cinder-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:11:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "cinder-quobyte-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "cinder-quobyte-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" acquired by "delete_volume" :: waited 0.019s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa3c68-9227-4287-9535-ddd56c1e9e3a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:11:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:11:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" returned: 0 in 1.852s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:11:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:11:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" returned: 0 in 0.680s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:11:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "cinder-quobyte-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48" released by "delete_volume" :: held 3.032s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Created reservations ['04c8e991-75f0-4588-9d28-1c256f17513d', 'ba4ccbf7-8640-45f9-a80c-773669c36b3a', '2589d61b-486f-48a9-845e-7c5b5837f57c', 'ea24084d-4e59-4d65-b91c-b86b614ad6e4'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.195s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:11:47 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:11:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Deleted volume successfully. Sep 25 21:11:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-919a7167-92f7-4bfc-aebe-f161e6ab0378 tempest-VolumesAssistedSnapshotsTest-1248964061 None] Lock "cinder-b955aa64-a64e-47d7-b3f9-5fb9dd4d6c48-delete_volume" released by "delete_volume" :: held 5.451s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:11:57 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:11:58 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:12:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:12:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.264s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:12:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:13:10 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (ab5725cb-9ede-409d-9277-4ede01bfc471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173e5b9e-fb4b-4604-95fb-7274b2907f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173e5b9e-fb4b-4604-95fb-7274b2907f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1224550444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5140e414-508c-48b7-9c64-8a6d337a62e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:13:10Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68784d5-d837-4ff5-b9da-b30500e2e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68784d5-d837-4ff5-b9da-b30500e2e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d700fdd1-3696-4f5f-a3fd-d0046e8ac02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d700fdd1-3696-4f5f-a3fd-d0046e8ac02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5140e414-508c-48b7-9c64-8a6d337a62e6', 'volume_name': 'volume-5140e414-508c-48b7-9c64-8a6d337a62e6', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96857178-ad79-4dc1-94f8-2bb760440f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96857178-ad79-4dc1-94f8-2bb760440f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adac21d8-d53b-443e-9ea9-51a8b9a16c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:10 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Volume 5140e414-508c-48b7-9c64-8a6d337a62e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5140e414-508c-48b7-9c64-8a6d337a62e6', 'volume_size': 1} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1224550444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5140e414-508c-48b7-9c64-8a6d337a62e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:13:10Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Creating volume 5140e414-508c-48b7-9c64-8a6d337a62e6 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:13:10 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:13:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:10 devstack quobyte-client[84349]: System call of process 87322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:10 devstack quobyte-client[84349]: System call of process 87322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:11 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=8, name=volume-5140e414-508c-48b7-9c64-8a6d337a62e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:13:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 1073741824" returned: 0 in 0.942s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6" returned: 0 in 0.325s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] <== create_volume: return (1482ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:13:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adac21d8-d53b-443e-9ea9-51a8b9a16c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5140e414-508c-48b7-9c64-8a6d337a62e6', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34320805-f666-4d36-aeff-2362c20e724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:13:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Volume volume-5140e414-508c-48b7-9c64-8a6d337a62e6 (5140e414-508c-48b7-9c64-8a6d337a62e6): created successfully Sep 25 21:13:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34320805-f666-4d36-aeff-2362c20e724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:13:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (ab5725cb-9ede-409d-9277-4ede01bfc471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:13:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d116f1a8-df4e-4c1b-b69a-ad23ef01b3b2 tempest-AttachVolumeNegativeTest-1341826901 None] Created volume successfully. Sep 25 21:13:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-42e4a09f-f089-44db-be85-997fc69436f9 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-42e4a09f-f089-44db-be85-997fc69436f9 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-42e4a09f-f089-44db-be85-997fc69436f9 tempest-TaggedBootDevicesTest-131600716 None] Terminate volume connection completed successfully. Sep 25 21:13:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-42e4a09f-f089-44db-be85-997fc69436f9 tempest-TaggedBootDevicesTest-131600716 None] Deleting attachment 16162a2e-c0a3-4dcb-b70b-634b37a3dfd2. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:13:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-e1c7b4d2-4199-4031-8239-266236e34fe0 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-e1c7b4d2-4199-4031-8239-266236e34fe0 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:17 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-e1c7b4d2-4199-4031-8239-266236e34fe0 tempest-TaggedBootDevicesTest-131600716 None] Terminate volume connection completed successfully. Sep 25 21:13:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-e1c7b4d2-4199-4031-8239-266236e34fe0 tempest-TaggedBootDevicesTest-131600716 None] Deleting attachment c019e667-81e2-448f-a775-e4b24a5871af. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:13:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-11a99b82-56f6-4460-934e-2f7e9a45ddac tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-11a99b82-56f6-4460-934e-2f7e9a45ddac tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-11a99b82-56f6-4460-934e-2f7e9a45ddac tempest-TaggedBootDevicesTest-131600716 None] Terminate volume connection completed successfully. Sep 25 21:13:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5d925170-e1b2-4da4-96a9-84e5e5cd170e req-11a99b82-56f6-4460-934e-2f7e9a45ddac tempest-TaggedBootDevicesTest-131600716 None] Deleting attachment 38aeec11-388b-4597-9e49-af8b0a01b3a5. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:13:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b38b3-b141-4cdb-8bb0-96729a54b095]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:13:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:19 devstack quobyte-client[84349]: System call of process 87338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:19 devstack quobyte-client[84349]: System call of process 87338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:19 devstack quobyte-client[84349]: System call of process 87338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6" returned: 0 in 0.659s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-5140e414-508c-48b7-9c64-8a6d337a62e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e44ecc0-8d98-4cd8-b03d-420e84e5a09b', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:13:19 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-ac45e31b-9c6f-45f0-b901-924a2d410281 req-abde64d8-2a2b-4e22-916c-ace044fc9516 tempest-AttachVolumeNegativeTest-1341826901 None] attachment_update completed successfully. Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-f8584953-1ecf-498a-8349-c304e3d6df41-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-f8584953-1ecf-498a-8349-c304e3d6df41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-quobyte-f8584953-1ecf-498a-8349-c304e3d6df41" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-f8584953-1ecf-498a-8349-c304e3d6df41" acquired by "delete_volume" :: waited 0.024s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aaf166-143d-47e5-af72-e76afbea5113]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:13:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:28 devstack quobyte-client[84349]: System call of process 87731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41" returned: 0 in 0.547s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f8584953-1ecf-498a-8349-c304e3d6df41" returned: 0 in 0.130s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-f8584953-1ecf-498a-8349-c304e3d6df41" released by "delete_volume" :: held 0.852s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:28 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Created reservations ['bc888faf-98a0-4dc6-b63e-540e820ba2e5', '2eb9e753-300f-49e4-8d24-8b8b76e70e8b', 'a28a8a1b-fac3-44b9-8ffb-3d64d5eb1e09', '2bf26b58-61ee-429b-a456-e645015e3830'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:13:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Deleted volume successfully. Sep 25 21:13:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cf386f0d-71b0-4d70-8bde-414bbfdefdd8 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-f8584953-1ecf-498a-8349-c304e3d6df41-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-88623740-bc33-411b-8248-713351cd51d2-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-88623740-bc33-411b-8248-713351cd51d2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:30 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-quobyte-88623740-bc33-411b-8248-713351cd51d2" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-88623740-bc33-411b-8248-713351cd51d2" acquired by "delete_volume" :: waited 0.037s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[faac239e-ae57-4a3d-8a93-1638c6eec620]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:13:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2" returned: 0 in 0.931s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-88623740-bc33-411b-8248-713351cd51d2" returned: 0 in 0.220s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-88623740-bc33-411b-8248-713351cd51d2" released by "delete_volume" :: held 1.437s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Created reservations ['d68ef637-e7ac-43c2-83fa-26c4976f2bc6', 'b1f85a79-9d13-4c3b-aac1-0348271cce88', '0014720b-d36e-458a-85c1-f5254af24750', 'ee923ea1-9285-4fb9-9fde-4c4ea5186dac'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-5eb00c8c-610d-4382-8647-66632e619df9-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.614s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:32 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:13:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Deleted volume successfully. Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-5eb00c8c-610d-4382-8647-66632e619df9-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-96652adb-175e-401a-a183-e41d3d5af66f tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-88623740-bc33-411b-8248-713351cd51d2-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:33 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "cinder-quobyte-5eb00c8c-610d-4382-8647-66632e619df9" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-5eb00c8c-610d-4382-8647-66632e619df9" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c014195e-fd38-4956-a16d-b3ed12e7c51a]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 0.468s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:34 devstack quobyte-client[84349]: System call of process 87746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 1 in 0.429s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5eb00c8c-610d-4382-8647-66632e619df9" returned: 0 in 0.129s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-quobyte-5eb00c8c-610d-4382-8647-66632e619df9" released by "delete_volume" :: held 1.288s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Created reservations ['2523be42-9df1-4c9f-a3f9-a6d5b17ae506', 'aaf2d3e3-a2f9-4869-8e73-c4e154bc3d1b', 'c6658c5b-c62e-4019-989e-2dfa09914815', 'd4fb5800-92d9-4ef2-862f-cef9d8efd253'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:35 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:13:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Deleted volume successfully. Sep 25 21:13:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5ed5336-c748-45e2-bd93-fa87e9fcd9f1 tempest-TaggedBootDevicesTest-131600716 None] Lock "cinder-5eb00c8c-610d-4382-8647-66632e619df9-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:13:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:13:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.092s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:13:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:13:47 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:13:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=5 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:14:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:14:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.295s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:14:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:15:33 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Flow 'volume_create_manager' (f40b1a4d-ca0d-418f-83c4-b56414e7451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dd10e3-25cd-4357-9f15-a3ecc677efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dd10e3-25cd-4357-9f15-a3ecc677efec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-819142397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf68643-8dd5-4194-a82e-707350b147ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b62b82479a34faa85274d762d97f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:15:33Z,use_quota=True,user_id='54c1854e530c442bb531a18520aa6d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc292d1a-a8dd-4ca8-9071-df777216a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc292d1a-a8dd-4ca8-9071-df777216a11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4529751-df55-42a1-a555-58bbd661a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4529751-df55-42a1-a555-58bbd661a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf68643-8dd5-4194-a82e-707350b147ea', 'volume_name': 'volume-edf68643-8dd5-4194-a82e-707350b147ea', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fcf9e7-41d8-47f1-a1d2-9edd23cb1c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fcf9e7-41d8-47f1-a1d2-9edd23cb1c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801e99c9-db0d-4db4-bfe6-274f79b2bd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:33 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume edf68643-8dd5-4194-a82e-707350b147ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf68643-8dd5-4194-a82e-707350b147ea', 'volume_size': 1} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-819142397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf68643-8dd5-4194-a82e-707350b147ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b62b82479a34faa85274d762d97f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:15:33Z,use_quota=True,user_id='54c1854e530c442bb531a18520aa6d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Creating volume edf68643-8dd5-4194-a82e-707350b147ea {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:15:33 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:15:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:15:34 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=9, name=volume-edf68643-8dd5-4194-a82e-707350b147ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea 1073741824" returned: 0 in 0.508s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] <== create_volume: return (707ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801e99c9-db0d-4db4-bfe6-274f79b2bd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf68643-8dd5-4194-a82e-707350b147ea', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14c6862-3eb9-464f-b32d-33ead65e971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:15:34 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume volume-edf68643-8dd5-4194-a82e-707350b147ea (edf68643-8dd5-4194-a82e-707350b147ea): created successfully Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14c6862-3eb9-464f-b32d-33ead65e971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:15:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Flow 'volume_create_manager' (f40b1a4d-ca0d-418f-83c4-b56414e7451d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:15:34 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9a763e35-9c2e-446e-8b70-11b565539af1 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Created volume successfully. Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7c3ce-0071-498c-8fd5-dc7c1e8ca596]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea" returned: 0 in 0.439s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.505s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:15:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:15:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:15:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.271s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:15:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:15:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-edf68643-8dd5-4194-a82e-707350b147ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8610d043-a7f5-449d-b86e-252ab82d422f', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:15:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:15:40 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-ac48e716-6e1f-4174-8ae4-3cfd1f2004e9 req-18c69c19-387b-4705-9cc9-458956d49ff8 tempest-AttachSCSIVolumeTestJSON-1212762200 None] attachment_update completed successfully. Sep 25 21:15:50 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:15:50 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:15:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-8581d4e0-7730-4326-a0bd-95c76f209edc req-6ac82392-5812-4ab8-97a1-cc2095a6aba3 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:15:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-8581d4e0-7730-4326-a0bd-95c76f209edc req-6ac82392-5812-4ab8-97a1-cc2095a6aba3 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:15:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-8581d4e0-7730-4326-a0bd-95c76f209edc req-6ac82392-5812-4ab8-97a1-cc2095a6aba3 tempest-AttachVolumeNegativeTest-1341826901 None] Terminate volume connection completed successfully. Sep 25 21:15:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-8581d4e0-7730-4326-a0bd-95c76f209edc req-6ac82392-5812-4ab8-97a1-cc2095a6aba3 tempest-AttachVolumeNegativeTest-1341826901 None] Deleting attachment 1e44ecc0-8d98-4cd8-b03d-420e84e5a09b. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:16:06 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-a6d1b7ca-110b-4178-b460-85f39cb148a5 req-fa914a0c-ac25-4162-bd21-e6efa23eef53 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:16:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-a6d1b7ca-110b-4178-b460-85f39cb148a5 req-fa914a0c-ac25-4162-bd21-e6efa23eef53 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:16:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-a6d1b7ca-110b-4178-b460-85f39cb148a5 req-fa914a0c-ac25-4162-bd21-e6efa23eef53 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Terminate volume connection completed successfully. Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-a6d1b7ca-110b-4178-b460-85f39cb148a5 req-fa914a0c-ac25-4162-bd21-e6efa23eef53 tempest-AttachSCSIVolumeTestJSON-1212762200 None] Deleting attachment 8610d043-a7f5-449d-b86e-252ab82d422f. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:16:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Flow 'volume_create_manager' (f8cdbbc3-0b3c-4a42-ac4c-8be6c58f2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73c2b0e-f9cd-44de-b411-6cef118c02a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73c2b0e-f9cd-44de-b411-6cef118c02a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1343192564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f729a1-31eb-4a1e-927d-1580fae8ff64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55a2abf0c4823b9351a514b4ad4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:16:09Z,use_quota=True,user_id='c614088c444746acbca6f2238bc82504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838cde2-854e-4cf6-a0e7-e839012b3fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838cde2-854e-4cf6-a0e7-e839012b3fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db77ff6-5204-497c-8fd5-1fafecbbbb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db77ff6-5204-497c-8fd5-1fafecbbbb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f729a1-31eb-4a1e-927d-1580fae8ff64', 'volume_name': 'volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e14a1a-a6f6-4caa-8960-e4d7919301cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e14a1a-a6f6-4caa-8960-e4d7919301cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6a2b5-db1e-4d76-8e67-81c3d05e7153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume a1f729a1-31eb-4a1e-927d-1580fae8ff64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64', 'volume_size': 1} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1343192564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f729a1-31eb-4a1e-927d-1580fae8ff64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55a2abf0c4823b9351a514b4ad4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:16:09Z,use_quota=True,user_id='c614088c444746acbca6f2238bc82504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Creating volume a1f729a1-31eb-4a1e-927d-1580fae8ff64 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:16:08 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:16:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:09 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=10, name=volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:16:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 1073741824" returned: 0 in 0.663s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64" returned: 0 in 0.287s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] <== create_volume: return (1146ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6a2b5-db1e-4d76-8e67-81c3d05e7153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52766453-28d5-4652-a7f5-9ae1750480b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:16:10 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 (a1f729a1-31eb-4a1e-927d-1580fae8ff64): created successfully Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52766453-28d5-4652-a7f5-9ae1750480b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:16:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Flow 'volume_create_manager' (f8cdbbc3-0b3c-4a42-ac4c-8be6c58f2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:16:10 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3d0bf360-8224-4cc7-9b6f-d3c2dac609e1 tempest-AttachVolumeShelveTestJSON-711361392 None] Created volume successfully. Sep 25 21:16:20 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:20 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "cinder-edf68643-8dd5-4194-a82e-707350b147ea-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "cinder-edf68643-8dd5-4194-a82e-707350b147ea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:16:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "cinder-quobyte-edf68643-8dd5-4194-a82e-707350b147ea" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "cinder-quobyte-edf68643-8dd5-4194-a82e-707350b147ea" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf89ac-54e4-4f0e-aef1-a4ff926fdbaf]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:16:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea" returned: 0 in 0.452s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-edf68643-8dd5-4194-a82e-707350b147ea" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "cinder-quobyte-edf68643-8dd5-4194-a82e-707350b147ea" released by "delete_volume" :: held 0.685s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Created reservations ['62b39079-4576-43ef-8e00-030973e30724', '49257088-fe15-458a-b9ec-0de26b3587dd', '18939936-f933-44b7-8406-a0ec8081b8a6', 'f00783b9-ba4b-45fa-9a38-7a3bf22079c5'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:16:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.126s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:27 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:16:27 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Deleted volume successfully. Sep 25 21:16:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2271a5a1-7378-44b0-a98f-e8b1f0de3a9f tempest-AttachSCSIVolumeTestJSON-1212762200 None] Lock "cinder-edf68643-8dd5-4194-a82e-707350b147ea-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:16:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:37 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.322s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:16:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:16:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:16:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a48bf2-70b0-42bc-9696-a42808156456]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:16:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:16:42 devstack quobyte-client[84349]: System call of process 88823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:16:42 devstack quobyte-client[84349]: System call of process 88823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:16:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64" returned: 0 in 1.600s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:16:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.713s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:16:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb185698-8ac9-4608-b904-7dcfcb72a7ca', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:16:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:16:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-602b3a48-2332-4aac-be70-7cdc3825e508 req-4a2d3907-0833-465f-bea9-2ca9f7e63385 tempest-AttachVolumeShelveTestJSON-711361392 None] attachment_update completed successfully. Sep 25 21:16:54 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:16:54 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:17:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:17:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:17:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:17:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:17:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:17:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:17:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:17:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.240s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:17:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:17:47 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:18:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (809611cf-b44d-4459-9f9f-edc76ba76bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1452de7a-f701-431e-a122-2e6541c5a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1452de7a-f701-431e-a122-2e6541c5a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1155817750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712ce7a-0854-4e5d-bce7-ffc10541ce03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:18:00Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ee3239-5be4-4ef5-b458-658643c13827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ee3239-5be4-4ef5-b458-658643c13827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc44ccf3-36a2-411b-988c-4c6d1b1076d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc44ccf3-36a2-411b-988c-4c6d1b1076d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c712ce7a-0854-4e5d-bce7-ffc10541ce03', 'volume_name': 'volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1974cd5-f773-4f72-b7cd-1731f9e3d749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1974cd5-f773-4f72-b7cd-1731f9e3d749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45988795-7d43-44dc-9aef-0bbcc4be566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Volume c712ce7a-0854-4e5d-bce7-ffc10541ce03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03', 'volume_size': 1} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1155817750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712ce7a-0854-4e5d-bce7-ffc10541ce03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:18:00Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Creating volume c712ce7a-0854-4e5d-bce7-ffc10541ce03 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:18:00 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:18:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:00 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=11, name=volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 1073741824" returned: 0 in 0.412s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03" returned: 0 in 0.107s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] <== create_volume: return (589ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.601s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45988795-7d43-44dc-9aef-0bbcc4be566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da28a81-36e4-4a9c-b70c-a305af61b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Volume volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 (c712ce7a-0854-4e5d-bce7-ffc10541ce03): created successfully Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da28a81-36e4-4a9c-b70c-a305af61b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (809611cf-b44d-4459-9f9f-edc76ba76bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:18:01 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9f4ac583-ff99-486c-9807-d270d5f29c10 tempest-AttachVolumeNegativeTest-1341826901 None] Created volume successfully. Sep 25 21:18:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:11 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ee46f-6505-46c6-9053-51b060e4c828]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:18:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:12 devstack quobyte-client[84349]: System call of process 89676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:18:12 devstack quobyte-client[84349]: System call of process 89676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:18:12 devstack quobyte-client[84349]: System call of process 89676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:18:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03" returned: 0 in 0.804s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f0f9446-6bb0-4281-a6f0-1c47bbcb3186', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:18:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5e0604cf-5667-4127-af27-2943bf5d36f3 req-8a4bd46c-37ea-4f19-9708-cd07fa2b58a2 tempest-AttachVolumeNegativeTest-1341826901 None] attachment_update completed successfully. Sep 25 21:18:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Flow 'volume_create_manager' (d5039323-b685-42aa-aa00-3184e84abfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1756d1-11d3-4aab-8daa-1419329c015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1756d1-11d3-4aab-8daa-1419329c015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1743650842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eefc854-3430-42db-aa29-6d9fb41bbeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbb1b125eb4fac8fb99396d211bc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:18:17Z,use_quota=True,user_id='633cd47c402c43d0ae308a260b887a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34901cac-bcac-4e72-8947-b87ac4ac187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34901cac-bcac-4e72-8947-b87ac4ac187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a9fb27-5c24-483c-a57c-6781c039f06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a9fb27-5c24-483c-a57c-6781c039f06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eefc854-3430-42db-aa29-6d9fb41bbeb1', 'volume_name': 'volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e17676-e9ea-47ea-9c99-1d715d668eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e17676-e9ea-47ea-9c99-1d715d668eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70850559-ec94-4d8a-9df9-96e3c77177b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:17 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Volume 6eefc854-3430-42db-aa29-6d9fb41bbeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1', 'volume_size': 1} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1743650842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eefc854-3430-42db-aa29-6d9fb41bbeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbb1b125eb4fac8fb99396d211bc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:18:17Z,use_quota=True,user_id='633cd47c402c43d0ae308a260b887a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Creating volume 6eefc854-3430-42db-aa29-6d9fb41bbeb1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:18:17 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:18:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:17 devstack quobyte-client[84349]: System call of process 89695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:18:17 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=12, name=volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 1073741824" returned: 0 in 0.366s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1" returned: 0 in 0.083s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70850559-ec94-4d8a-9df9-96e3c77177b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b83cc0-f0fc-4196-9ba8-560498291a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:18:18 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Volume volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 (6eefc854-3430-42db-aa29-6d9fb41bbeb1): created successfully Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b83cc0-f0fc-4196-9ba8-560498291a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:18:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Flow 'volume_create_manager' (d5039323-b685-42aa-aa00-3184e84abfa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:18:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-eca7fd67-0b3f-4daf-8f6a-80037eb93bd9 tempest-VolumesAdminNegativeTest-1909411867 None] Created volume successfully. Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Acquiring lock "cinder-6eefc854-3430-42db-aa29-6d9fb41bbeb1-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "cinder-6eefc854-3430-42db-aa29-6d9fb41bbeb1-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:18:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Acquiring lock "cinder-quobyte-6eefc854-3430-42db-aa29-6d9fb41bbeb1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "cinder-quobyte-6eefc854-3430-42db-aa29-6d9fb41bbeb1" acquired by "delete_volume" :: waited 0.031s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db16ad-16e8-463e-ad4b-bcf5b79c4225]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:18:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:21 devstack quobyte-client[84349]: System call of process 89699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:18:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1" returned: 0 in 0.888s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6eefc854-3430-42db-aa29-6d9fb41bbeb1" returned: 0 in 0.230s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "cinder-quobyte-6eefc854-3430-42db-aa29-6d9fb41bbeb1" released by "delete_volume" :: held 1.329s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Created reservations ['41feb6b1-863c-40f1-9253-44fc4aa8b8a9', '09fb4573-2412-45b4-8010-6004b324ef87', 'f0307ef1-5298-4d1a-b79a-ae18dfcb58d0', 'f9a11d69-fbf4-412d-805f-9f68da98c4b3'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.150s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:18:22 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:18:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Deleted volume successfully. Sep 25 21:18:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8fdcc81d-cc93-41de-9a9d-2479f37b8652 tempest-VolumesAdminNegativeTest-1909411867 None] Lock "cinder-6eefc854-3430-42db-aa29-6d9fb41bbeb1-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:18:32 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=9,cinder:SELECT=12,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:18:32 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:18:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-0fae87fe-abdd-445c-b23c-29b299144a59 req-15c59a65-2669-4f19-a9d4-fe4248a18f51 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-0fae87fe-abdd-445c-b23c-29b299144a59 req-15c59a65-2669-4f19-a9d4-fe4248a18f51 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-0fae87fe-abdd-445c-b23c-29b299144a59 req-15c59a65-2669-4f19-a9d4-fe4248a18f51 tempest-AttachVolumeNegativeTest-1341826901 None] Terminate volume connection completed successfully. Sep 25 21:18:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-0fae87fe-abdd-445c-b23c-29b299144a59 req-15c59a65-2669-4f19-a9d4-fe4248a18f51 tempest-AttachVolumeNegativeTest-1341826901 None] Deleting attachment 2f0f9446-6bb0-4281-a6f0-1c47bbcb3186. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:18:52 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:18:52 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:18:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-96e67327-5676-410d-9068-43474aab441f req-70a80584-4cbb-4ab6-b467-aafb33e22805 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-96e67327-5676-410d-9068-43474aab441f req-70a80584-4cbb-4ab6-b467-aafb33e22805 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:18:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-96e67327-5676-410d-9068-43474aab441f req-70a80584-4cbb-4ab6-b467-aafb33e22805 tempest-AttachVolumeShelveTestJSON-711361392 None] Terminate volume connection completed successfully. Sep 25 21:18:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-96e67327-5676-410d-9068-43474aab441f req-70a80584-4cbb-4ab6-b467-aafb33e22805 tempest-AttachVolumeShelveTestJSON-711361392 None] Deleting attachment fb185698-8ac9-4608-b904-7dcfcb72a7ca. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:19:08 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:19:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:19:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:19:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:19:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:19:47 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:19:57 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Flow 'volume_create_manager' (0fe43a21-a024-41e1-aeda-5fe9ab23e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64d3f19-a246-4d38-9fd4-b4c7cdabff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64d3f19-a246-4d38-9fd4-b4c7cdabff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-705112393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760deaea-c6f9-4e1d-8df5-25bd10f0f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d15276181d48a188e4bb3587881f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:19:57Z,use_quota=True,user_id='fb50dcd8828a4cd99fecdbc56993686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15dfcec-bbe7-4439-85f9-102204ca3613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15dfcec-bbe7-4439-85f9-102204ca3613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b181ed-a07a-4d39-8e00-a6465bb6b41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b181ed-a07a-4d39-8e00-a6465bb6b41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760deaea-c6f9-4e1d-8df5-25bd10f0f018', 'volume_name': 'volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2761757d-7e91-4e8f-9edd-6ed485708f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2761757d-7e91-4e8f-9edd-6ed485708f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db52f59-d0c5-45bf-af6e-445596c23f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:19:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Volume 760deaea-c6f9-4e1d-8df5-25bd10f0f018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018', 'volume_size': 1} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-705112393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760deaea-c6f9-4e1d-8df5-25bd10f0f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d15276181d48a188e4bb3587881f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:19:57Z,use_quota=True,user_id='fb50dcd8828a4cd99fecdbc56993686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Creating volume 760deaea-c6f9-4e1d-8df5-25bd10f0f018 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:19:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:19:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:19:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:19:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:19:58 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:19:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:19:58 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=13, name=volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:19:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 1073741824" returned: 0 in 1.481s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:19:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:19:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018" returned: 0 in 0.181s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:19:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] <== create_volume: return (1798ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:19:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db52f59-d0c5-45bf-af6e-445596c23f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d136f128-1d77-44c5-a025-3fb35a5bfa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Volume volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 (760deaea-c6f9-4e1d-8df5-25bd10f0f018): created successfully Sep 25 21:20:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d136f128-1d77-44c5-a025-3fb35a5bfa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Flow 'volume_create_manager' (0fe43a21-a024-41e1-aeda-5fe9ab23e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:20:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-33f06a6d-7095-4cc5-91ed-7277ee94ebd0 tempest-DeleteServersTestJSON-135137959 None] Created volume successfully. Sep 25 21:20:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:05 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb0be5-0d0c-41db-9f2f-8f5cbcf6646a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:20:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:06 devstack quobyte-client[84349]: System call of process 90303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:20:06 devstack quobyte-client[84349]: System call of process 90303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:20:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018" returned: 0 in 1.023s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.134s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c9f52ff-d8b2-46f3-9ddc-8ec7d861856e', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:20:06 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:07 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-ed301625-fb5c-42bd-bdcb-1b69dccc840c req-0b274231-8ba4-4c56-b98d-0428574bd26d tempest-DeleteServersTestJSON-135137959 None] attachment_update completed successfully. Sep 25 21:20:17 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:20:17 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:20:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-27c01fc9-2dc7-498e-8968-8083a75a19e5 req-d7b32e28-27b1-4661-9a25-ecc69734e323 tempest-DeleteServersTestJSON-135137959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-27c01fc9-2dc7-498e-8968-8083a75a19e5 req-d7b32e28-27b1-4661-9a25-ecc69734e323 tempest-DeleteServersTestJSON-135137959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:23 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-27c01fc9-2dc7-498e-8968-8083a75a19e5 req-d7b32e28-27b1-4661-9a25-ecc69734e323 tempest-DeleteServersTestJSON-135137959 None] Terminate volume connection completed successfully. Sep 25 21:20:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-27c01fc9-2dc7-498e-8968-8083a75a19e5 req-d7b32e28-27b1-4661-9a25-ecc69734e323 tempest-DeleteServersTestJSON-135137959 None] Deleting attachment 8c9f52ff-d8b2-46f3-9ddc-8ec7d861856e. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:20:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "cinder-760deaea-c6f9-4e1d-8df5-25bd10f0f018-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:20:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "cinder-760deaea-c6f9-4e1d-8df5-25bd10f0f018-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:20:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "cinder-quobyte-760deaea-c6f9-4e1d-8df5-25bd10f0f018" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:20:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "cinder-quobyte-760deaea-c6f9-4e1d-8df5-25bd10f0f018" acquired by "delete_volume" :: waited 0.020s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc736914-3a88-48ce-acc1-deca718c918d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:28 devstack quobyte-client[84349]: System call of process 90794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018" returned: 0 in 0.474s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-760deaea-c6f9-4e1d-8df5-25bd10f0f018" returned: 0 in 0.114s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "cinder-quobyte-760deaea-c6f9-4e1d-8df5-25bd10f0f018" released by "delete_volume" :: held 0.760s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Created reservations ['1d55d525-7a41-42c5-b2d9-5dc5011c2081', '6793acab-a037-4ee0-985c-2d4b1293369b', 'c1ba9239-259e-4606-8b69-d1b2e420a074', '5f327466-b892-4080-8ac0-d44c16d8c834'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:20:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Deleted volume successfully. Sep 25 21:20:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-455f1b85-92bb-4f22-bdaa-413ee81acbc6 tempest-DeleteServersTestJSON-135137959 None] Lock "cinder-760deaea-c6f9-4e1d-8df5-25bd10f0f018-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:20:39 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (71bba4d6-d471-4472-bc08-4edac7e2e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191d9264-1926-405f-abfa-07e2a10f4994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191d9264-1926-405f-abfa-07e2a10f4994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1926893899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:20:39Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a409159-d5e7-4c7f-b128-3b359e96b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a409159-d5e7-4c7f-b128-3b359e96b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9bd552-7b86-497c-9d41-e22f113bc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9bd552-7b86-497c-9d41-e22f113bc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec', 'volume_name': 'volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ccebbc-afad-4ef4-98fb-c0384e03941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ccebbc-afad-4ef4-98fb-c0384e03941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59f6bd4-7730-4b20-911f-a79a44a826d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:39 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Volume efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec', 'volume_size': 1} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1926893899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4afc031cd4dc18933d17f3cf966dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:20:39Z,use_quota=True,user_id='f79e0efda69844bc9353a26535cd8ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Creating volume efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:20:39 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:20:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:39 devstack quobyte-client[84349]: System call of process 90839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:20:39 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=14, name=volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.042s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec 1073741824" returned: 0 in 0.904s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.414s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" returned: 0 in 0.433s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] <== create_volume: return (1459ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:20:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59f6bd4-7730-4b20-911f-a79a44a826d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b80379-dae6-4827-9122-3abf35ea1b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:20:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Volume volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec (efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec): created successfully Sep 25 21:20:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b80379-dae6-4827-9122-3abf35ea1b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:20:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Flow 'volume_create_manager' (71bba4d6-d471-4472-bc08-4edac7e2e834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:20:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e6547244-38fc-45bf-a6ae-459e58d89439 tempest-AttachVolumeNegativeTest-1341826901 None] Created volume successfully. Sep 25 21:20:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:20:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:20:46 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f0681-7e3f-4f25-a71d-0d59d31c6951]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:20:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:20:46 devstack quobyte-client[84349]: System call of process 90853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:20:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" returned: 0 in 0.533s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:20:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.602s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:20:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4195bf99-24bf-405c-b246-4682846b11f9', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:20:47 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:20:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-38dfa143-9a28-4614-a012-5659aa2c1e19 req-29e2eb23-1f47-4135-876e-5eb29074cf00 tempest-AttachVolumeNegativeTest-1341826901 None] attachment_update completed successfully. Sep 25 21:20:57 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:20:57 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:21:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Flow 'volume_create_manager' (f36c94a5-d5e9-4bdb-8d79-107719ed8c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40917263-a190-4431-b2b9-395a5dd93f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40917263-a190-4431-b2b9-395a5dd93f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387486609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ca007-c8e6-4b36-9b6a-9c71755e8abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55a2abf0c4823b9351a514b4ad4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:21:02Z,use_quota=True,user_id='c614088c444746acbca6f2238bc82504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ead4ef5-6ad5-4a62-862b-117a9adfcf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ead4ef5-6ad5-4a62-862b-117a9adfcf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fde9a38-0bc0-4358-abcf-f891cc8969dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fde9a38-0bc0-4358-abcf-f891cc8969dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602ca007-c8e6-4b36-9b6a-9c71755e8abe', 'volume_name': 'volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba04e83b-5178-4c14-a3ca-aa8b13869a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba04e83b-5178-4c14-a3ca-aa8b13869a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a934b-1156-4582-8012-302d432fa3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Volume 602ca007-c8e6-4b36-9b6a-9c71755e8abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe', 'volume_size': 1} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387486609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ca007-c8e6-4b36-9b6a-9c71755e8abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55a2abf0c4823b9351a514b4ad4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:21:02Z,use_quota=True,user_id='c614088c444746acbca6f2238bc82504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Creating volume 602ca007-c8e6-4b36-9b6a-9c71755e8abe {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:21:02 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:21:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:02 devstack quobyte-client[84349]: System call of process 91298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:21:03 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=15, name=volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe 1073741824" returned: 0 in 0.455s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe" returned: 0 in 0.170s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] <== create_volume: return (852ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a934b-1156-4582-8012-302d432fa3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c0237-dbfd-47c7-8fda-2fdd47dd3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Volume volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe (602ca007-c8e6-4b36-9b6a-9c71755e8abe): created successfully Sep 25 21:21:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c0237-dbfd-47c7-8fda-2fdd47dd3a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Flow 'volume_create_manager' (f36c94a5-d5e9-4bdb-8d79-107719ed8c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:21:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a39923f8-d0ef-46cb-8133-04cddd4a6eed tempest-AttachVolumeShelveTestJSON-711361392 None] Created volume successfully. Sep 25 21:21:06 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Flow 'volume_create_manager' (a54cbaa7-3ccb-4ae4-8c38-028db9daf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369701a0-59ff-4cd5-9d9e-9e6de045d420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369701a0-59ff-4cd5-9d9e-9e6de045d420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888793007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd9d00d-0408-4b8b-86c6-08d1fe34497e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c9b5ca2bf44f748809868aa31ef746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:21:06Z,use_quota=True,user_id='d3062b044ad849eeba59b3914abb2cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c351b10-c093-4011-89ca-f08207ee7e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c351b10-c093-4011-89ca-f08207ee7e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f237c02-a233-4960-85a6-2589508c629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f237c02-a233-4960-85a6-2589508c629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd9d00d-0408-4b8b-86c6-08d1fe34497e', 'volume_name': 'volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5ec0f4-5bf5-4c9e-bdd0-896c9390dd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5ec0f4-5bf5-4c9e-bdd0-896c9390dd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898ec170-7298-4a28-aeb0-95153060d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:07 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Volume 0dd9d00d-0408-4b8b-86c6-08d1fe34497e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e', 'volume_size': 1} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888793007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd9d00d-0408-4b8b-86c6-08d1fe34497e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c9b5ca2bf44f748809868aa31ef746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:21:06Z,use_quota=True,user_id='d3062b044ad849eeba59b3914abb2cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Creating volume 0dd9d00d-0408-4b8b-86c6-08d1fe34497e {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:21:07 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:21:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:07 devstack quobyte-client[84349]: System call of process 91315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:21:07 devstack quobyte-client[84349]: System call of process 91315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:21:07 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=16, name=volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e 1073741824" returned: 0 in 0.906s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" returned: 0 in 0.331s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] <== create_volume: return (1416ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898ec170-7298-4a28-aeb0-95153060d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6f942f-527f-44db-8f66-da2d3b2291b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:21:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Volume volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e (0dd9d00d-0408-4b8b-86c6-08d1fe34497e): created successfully Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6f942f-527f-44db-8f66-da2d3b2291b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:21:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Flow 'volume_create_manager' (a54cbaa7-3ccb-4ae4-8c38-028db9daf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:21:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0f16b499-13d1-46c8-800b-1e0577559d85 tempest-TaggedAttachmentsTest-606044682 None] Created volume successfully. Sep 25 21:21:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-01b50c24-62da-43ee-861e-443b38a9f81d req-da6e2bc6-bf08-4d4d-9a7b-95eebdef37ec tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-01b50c24-62da-43ee-861e-443b38a9f81d req-da6e2bc6-bf08-4d4d-9a7b-95eebdef37ec tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:17 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-01b50c24-62da-43ee-861e-443b38a9f81d req-da6e2bc6-bf08-4d4d-9a7b-95eebdef37ec tempest-AttachVolumeNegativeTest-1341826901 None] Terminate volume connection completed successfully. Sep 25 21:21:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-01b50c24-62da-43ee-861e-443b38a9f81d req-da6e2bc6-bf08-4d4d-9a7b-95eebdef37ec tempest-AttachVolumeNegativeTest-1341826901 None] Deleting attachment 4195bf99-24bf-405c-b246-4682846b11f9. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:21:27 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:21:27 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=5,cinder:DELETE=2,cinder:SELECT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:21:30 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-87e0e25d-75a7-4fba-9486-e3d7cc7269a6 req-4691e8d5-4e11-4e24-8266-9c48e420786d tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:30 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-87e0e25d-75a7-4fba-9486-e3d7cc7269a6 req-4691e8d5-4e11-4e24-8266-9c48e420786d tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-87e0e25d-75a7-4fba-9486-e3d7cc7269a6 req-4691e8d5-4e11-4e24-8266-9c48e420786d tempest-AttachVolumeShelveTestJSON-711361392 None] No connector for attachment 8c25dee5-4709-4948-9c35-f1b53416c45b; skipping storage backend terminate_connection call. {{(pid=84334) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 25 21:21:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-87e0e25d-75a7-4fba-9486-e3d7cc7269a6 req-4691e8d5-4e11-4e24-8266-9c48e420786d tempest-AttachVolumeShelveTestJSON-711361392 None] Deleting attachment 8c25dee5-4709-4948-9c35-f1b53416c45b. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:32 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-quobyte-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" acquired by "delete_volume" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5fbab-369e-48ee-9853-f2b4f002b504]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:21:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" returned: 0 in 0.517s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec" released by "delete_volume" :: held 0.834s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Created reservations ['988901c5-4db3-459b-8b59-463011ed5ae3', '462771a6-36e2-4835-a948-8b120942f074', '43df2ee5-fee6-4378-852e-2a03751f267c', '8abf73ba-4e23-49fc-b381-a8bef373998e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:21:34 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Deleted volume successfully. Sep 25 21:21:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a219acc8-dfc1-4a1b-a297-1d1168c9944f tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-efb6e76e-fbdd-4f6f-bb73-5b1277bcb5ec-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-c712ce7a-0854-4e5d-bce7-ffc10541ce03-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-c712ce7a-0854-4e5d-bce7-ffc10541ce03-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:36 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-quobyte-c712ce7a-0854-4e5d-bce7-ffc10541ce03" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-c712ce7a-0854-4e5d-bce7-ffc10541ce03" acquired by "delete_volume" :: waited 0.049s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:36 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0058303-17d1-4039-9768-2870759e1a0d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:21:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:37 devstack quobyte-client[84349]: System call of process 91539 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:21:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03" returned: 0 in 1.030s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c712ce7a-0854-4e5d-bce7-ffc10541ce03" returned: 0 in 0.232s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-c712ce7a-0854-4e5d-bce7-ffc10541ce03" released by "delete_volume" :: held 1.653s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Created reservations ['b35e470e-e3f2-429a-9340-9b88d4879b92', 'aba2b5c8-8c75-445c-b2e0-904966a43032', '1e09ff68-6c76-41e5-a8f2-86ff84f9bd07', '1d535099-da36-4487-b9d2-650d39a8f6e1'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.245s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:39 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:21:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Deleted volume successfully. Sep 25 21:21:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b844e15e-bbc6-435a-b874-28b720983dba tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-c712ce7a-0854-4e5d-bce7-ffc10541ce03-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-5140e414-508c-48b7-9c64-8a6d337a62e6-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-5140e414-508c-48b7-9c64-8a6d337a62e6-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.682s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:21:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:21:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "cinder-quobyte-5140e414-508c-48b7-9c64-8a6d337a62e6" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:21:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-5140e414-508c-48b7-9c64-8a6d337a62e6" acquired by "delete_volume" :: waited 0.106s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:21:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275a368-191d-4846-8794-8a658a93f6aa]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:21:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6" returned: 0 in 0.882s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5140e414-508c-48b7-9c64-8a6d337a62e6" returned: 0 in 0.179s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-quobyte-5140e414-508c-48b7-9c64-8a6d337a62e6" released by "delete_volume" :: held 1.746s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Created reservations ['96580cfb-8c39-4296-a39c-0409e3046c5e', 'a43160f6-014d-4558-9a33-e01914176a27', 'bb13ed65-ee9e-4f83-8f2a-4c78baabfd7b', '9972165e-faa0-402a-a783-f7aa0d1d515d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:21:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:21:44 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:21:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Deleted volume successfully. Sep 25 21:21:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-456d5fe6-ea74-486d-bb55-135bd0a175fb tempest-AttachVolumeNegativeTest-1341826901 None] Lock "cinder-5140e414-508c-48b7-9c64-8a6d337a62e6-delete_volume" released by "delete_volume" :: held 4.384s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:21:53 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=22 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:21:54 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=13,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:22:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4c1a76b2-9788-4961-b356-c50127d3a97f tempest-BackendsCapabilitiesAdminTestsJSON-953147555 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84334) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 25 21:22:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-da3ad6f6-03f4-4ceb-aab5-7b86d161274c tempest-BackendsCapabilitiesAdminTestsJSON-953147555 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84334) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 25 21:22:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0eed6f1e-3f6d-445f-a10a-51114753d0a7 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:31 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0eed6f1e-3f6d-445f-a10a-51114753d0a7 tempest-GroupsTest-1138779160 None] Group tempest-Group1-2124639957: creating Sep 25 21:22:31 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0eed6f1e-3f6d-445f-a10a-51114753d0a7 tempest-GroupsTest-1138779160 None] Group tempest-Group1-2124639957: created successfully Sep 25 21:22:31 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0eed6f1e-3f6d-445f-a10a-51114753d0a7 tempest-GroupsTest-1138779160 None] Create group completed successfully. Sep 25 21:22:32 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-58c12f2e-c1f3-4964-b053-ecb7ede6821e tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58c12f2e-c1f3-4964-b053-ecb7ede6821e tempest-GroupsTest-1138779160 None] Group tempest-Group2-214151562: creating Sep 25 21:22:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58c12f2e-c1f3-4964-b053-ecb7ede6821e tempest-GroupsTest-1138779160 None] Group tempest-Group2-214151562: created successfully Sep 25 21:22:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58c12f2e-c1f3-4964-b053-ecb7ede6821e tempest-GroupsTest-1138779160 None] Create group completed successfully. Sep 25 21:22:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (eb3d0786-b9d0-4c73-afd4-6e3c59fd9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad70753-9335-45fd-950d-241725ae3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad70753-9335-45fd-950d-241725ae3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427681028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46c9939b-7a0a-4fcb-bc1a-e00c49a8391a,host='devstack@QuobyteHD#QuobyteHD',id=d152ad14-f8bf-4e35-9611-4dbe6c3540c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:34Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e06de93-d193-4f0a-869a-8352679b2017),volume_type_id=5e06de93-d193-4f0a-869a-8352679b2017)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517f0b37-c3d8-4890-8596-23ee0c63b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517f0b37-c3d8-4890-8596-23ee0c63b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bc4f5d-af2b-460d-81eb-43b92cb6359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bc4f5d-af2b-460d-81eb-43b92cb6359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd152ad14-f8bf-4e35-9611-4dbe6c3540c9', 'volume_name': 'volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00daab11-4e29-48bb-a653-9191b4854ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00daab11-4e29-48bb-a653-9191b4854ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854a6e91-d840-4755-984b-593f238ac5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:34 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Volume d152ad14-f8bf-4e35-9611-4dbe6c3540c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9', 'volume_size': 1} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46c9939b-7a0a-4fcb-bc1a-e00c49a8391a,created_at=2025-09-25T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427681028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46c9939b-7a0a-4fcb-bc1a-e00c49a8391a,host='devstack@QuobyteHD#QuobyteHD',id=d152ad14-f8bf-4e35-9611-4dbe6c3540c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:34Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e06de93-d193-4f0a-869a-8352679b2017),volume_type_id=5e06de93-d193-4f0a-869a-8352679b2017)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Creating volume d152ad14-f8bf-4e35-9611-4dbe6c3540c9 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:22:34 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:34 devstack quobyte-client[84349]: System call of process 91779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:34 devstack quobyte-client[84349]: System call of process 91779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:34 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=17, name=volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 1073741824" returned: 0 in 0.411s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" returned: 0 in 0.106s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] <== create_volume: return (620ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854a6e91-d840-4755-984b-593f238ac5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845494c4-f5fd-4fdd-8a3a-3f6da5ea2701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:35 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Volume volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 (d152ad14-f8bf-4e35-9611-4dbe6c3540c9): created successfully Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845494c4-f5fd-4fdd-8a3a-3f6da5ea2701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (eb3d0786-b9d0-4c73-afd4-6e3c59fd9a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-6a872ffd-48f4-4943-b827-ee2889ccefc1 tempest-GroupsTest-1138779160 None] Created volume successfully. Sep 25 21:22:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Acquiring lock "cinder-quobyte-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:22:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" acquired by "delete_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:22:37 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4807b71-762c-4dbb-b614-228921f6cf67]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:22:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" returned: 0 in 0.489s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" returned: 0 in 0.140s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-d152ad14-f8bf-4e35-9611-4dbe6c3540c9" released by "delete_volume" :: held 0.773s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Created reservations ['de8e67c4-f67e-405a-9bda-da9bb1424af7'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:38 devstack cinder-volume[84334]: WARNING cinder.quota [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-328525829 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-328525829, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:22:38 devstack cinder-volume[84334]: WARNING cinder.quota [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-328525829 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-328525829, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Created reservations ['b4512158-dff9-4576-a286-9ee9b3d8dba0', '4cb2b25f-ea71-4fc3-a714-fa74c699b583', 'faf576f1-c6d2-4498-8cb5-07baaf094a44', 'bee8c6ed-1826-4b4f-bbb3-41e50c9e0c96'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:39 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:22:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-173dd5da-022e-45cc-af03-c9ba893f7617 tempest-GroupsTest-1138779160 None] Delete group completed successfully. Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.193s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:22:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Created reservations ['ac5d8185-180c-4d30-bb2f-49bb8dca572f'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.167s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:22:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-aa2db441-80f5-453e-aafa-b10785f27fd9 tempest-GroupsTest-1138779160 None] Delete group completed successfully. Sep 25 21:22:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bddabcef-0669-4c46-8f75-bdf3c48c642d tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bddabcef-0669-4c46-8f75-bdf3c48c642d tempest-GroupsTest-1138779160 None] Group tempest-GroupsTest-Group-1377763523: creating Sep 25 21:22:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bddabcef-0669-4c46-8f75-bdf3c48c642d tempest-GroupsTest-1138779160 None] Group tempest-GroupsTest-Group-1377763523: created successfully Sep 25 21:22:43 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bddabcef-0669-4c46-8f75-bdf3c48c642d tempest-GroupsTest-1138779160 None] Create group completed successfully. Sep 25 21:22:44 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (3469a5ee-20e1-4f11-9f1e-f39960d251bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c46825e-d3e0-4431-b428-edcf8bf37631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c46825e-d3e0-4431-b428-edcf8bf37631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903655985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,host='devstack@QuobyteHD#QuobyteHD',id=b78e30aa-f0d3-411b-a99a-0803fd27383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:44Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82292cde-d0c5-4b8f-8547-befcad90aa18),volume_type_id=82292cde-d0c5-4b8f-8547-befcad90aa18)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dde9063-0589-4cfc-b946-8eba4aa75902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dde9063-0589-4cfc-b946-8eba4aa75902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b3169c-102e-4bd8-b2f8-cb47e6663a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b3169c-102e-4bd8-b2f8-cb47e6663a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78e30aa-f0d3-411b-a99a-0803fd27383e', 'volume_name': 'volume-b78e30aa-f0d3-411b-a99a-0803fd27383e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c378e90-216a-4c1d-ad65-9918e0e80abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c378e90-216a-4c1d-ad65-9918e0e80abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f053ebc4-a35f-478d-9f96-2a2b239b98e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Volume b78e30aa-f0d3-411b-a99a-0803fd27383e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78e30aa-f0d3-411b-a99a-0803fd27383e', 'volume_size': 1} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,created_at=2025-09-25T19:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903655985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,host='devstack@QuobyteHD#QuobyteHD',id=b78e30aa-f0d3-411b-a99a-0803fd27383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:44Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82292cde-d0c5-4b8f-8547-befcad90aa18),volume_type_id=82292cde-d0c5-4b8f-8547-befcad90aa18)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Creating volume b78e30aa-f0d3-411b-a99a-0803fd27383e {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:22:44 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:22:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:44 devstack quobyte-client[84349]: System call of process 91798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:44 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=18, name=volume-b78e30aa-f0d3-411b-a99a-0803fd27383e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e 1073741824" returned: 0 in 0.385s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e" returned: 0 in 0.111s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.586s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f053ebc4-a35f-478d-9f96-2a2b239b98e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78e30aa-f0d3-411b-a99a-0803fd27383e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ec4e9-8cea-43df-8ff4-45e53729c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:45 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Volume volume-b78e30aa-f0d3-411b-a99a-0803fd27383e (b78e30aa-f0d3-411b-a99a-0803fd27383e): created successfully Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ec4e9-8cea-43df-8ff4-45e53729c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (3469a5ee-20e1-4f11-9f1e-f39960d251bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:45 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-489f0a0c-e3de-4056-a5c2-f771f98ea4a8 tempest-GroupsTest-1138779160 None] Created volume successfully. Sep 25 21:22:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (96104bff-0603-4774-931d-9d507b6a24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e882ce4b-4fd2-4e34-97a8-77ec5cf706eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e882ce4b-4fd2-4e34-97a8-77ec5cf706eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614627726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,host='devstack@QuobyteHD#QuobyteHD',id=81288939-966d-40f5-a7ef-2eabc018dc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:46Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82292cde-d0c5-4b8f-8547-befcad90aa18),volume_type_id=82292cde-d0c5-4b8f-8547-befcad90aa18)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79e463a-98da-4e3c-a714-45c3350dc9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79e463a-98da-4e3c-a714-45c3350dc9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60f95ce-dc80-402d-96c2-32dc1409cfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60f95ce-dc80-402d-96c2-32dc1409cfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81288939-966d-40f5-a7ef-2eabc018dc59', 'volume_name': 'volume-81288939-966d-40f5-a7ef-2eabc018dc59', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859890e3-e837-42a4-b3b3-60a6c09c6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859890e3-e837-42a4-b3b3-60a6c09c6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b12ad69-f712-46c1-9c2d-9035a034db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Volume 81288939-966d-40f5-a7ef-2eabc018dc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81288939-966d-40f5-a7ef-2eabc018dc59', 'volume_size': 1} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,created_at=2025-09-25T19:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614627726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24904c9a-5e8a-4ab7-b9af-0c2b5383b543,host='devstack@QuobyteHD#QuobyteHD',id=81288939-966d-40f5-a7ef-2eabc018dc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500807317b0498c90d13ad5a81e6adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:22:46Z,use_quota=True,user_id='342d353f92674a6bafd896111909eaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82292cde-d0c5-4b8f-8547-befcad90aa18),volume_type_id=82292cde-d0c5-4b8f-8547-befcad90aa18)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Creating volume 81288939-966d-40f5-a7ef-2eabc018dc59 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:22:46 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:46 devstack quobyte-client[84349]: System call of process 91803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:46 devstack quobyte-client[84349]: System call of process 91803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:46 devstack quobyte-client[84349]: System call of process 91803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:46 devstack quobyte-client[84349]: System call of process 91803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:46 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=19, name=volume-81288939-966d-40f5-a7ef-2eabc018dc59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59 1073741824" returned: 0 in 0.360s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] <== create_volume: return (545ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b12ad69-f712-46c1-9c2d-9035a034db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81288939-966d-40f5-a7ef-2eabc018dc59', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adf8419-0397-42a2-8a38-f265747be8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:22:47 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Volume volume-81288939-966d-40f5-a7ef-2eabc018dc59 (81288939-966d-40f5-a7ef-2eabc018dc59): created successfully Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adf8419-0397-42a2-8a38-f265747be8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:22:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Flow 'volume_create_manager' (96104bff-0603-4774-931d-9d507b6a24f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:22:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-06b084af-ede6-4d7f-a4e0-fc0aa01ea7ab tempest-GroupsTest-1138779160 None] Created volume successfully. Sep 25 21:22:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-92dac3e5-0165-4a7d-bba0-5b6fff3a1672 tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-92dac3e5-0165-4a7d-bba0-5b6fff3a1672 tempest-GroupsTest-1138779160 None] Update group completed successfully. Sep 25 21:22:50 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dabad53b-e327-41c2-8e38-033780b187fb tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dabad53b-e327-41c2-8e38-033780b187fb tempest-GroupsTest-1138779160 None] Update group completed successfully. Sep 25 21:22:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:22:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Acquiring lock "cinder-quobyte-81288939-966d-40f5-a7ef-2eabc018dc59" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:22:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-81288939-966d-40f5-a7ef-2eabc018dc59" acquired by "delete_volume" :: waited 0.065s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:22:51 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[60edb10b-9e8d-4e77-b518-587b86ad8a7a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:22:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:52 devstack quobyte-client[84349]: System call of process 91819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:52 devstack quobyte-client[84349]: System call of process 91819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:52 devstack quobyte-client[84349]: System call of process 91819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59" returned: 0 in 0.681s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-81288939-966d-40f5-a7ef-2eabc018dc59" returned: 0 in 0.171s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-81288939-966d-40f5-a7ef-2eabc018dc59" released by "delete_volume" :: held 1.292s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Acquiring lock "cinder-quobyte-b78e30aa-f0d3-411b-a99a-0803fd27383e" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-b78e30aa-f0d3-411b-a99a-0803fd27383e" acquired by "delete_volume" :: waited 0.060s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[837072a3-2574-4e50-b37e-e5fd1ed8e9e8]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:53 devstack quobyte-client[84349]: System call of process 91825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e" returned: 0 in 0.592s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b78e30aa-f0d3-411b-a99a-0803fd27383e" returned: 0 in 0.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "cinder-quobyte-b78e30aa-f0d3-411b-a99a-0803fd27383e" released by "delete_volume" :: held 0.913s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:22:54 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Created reservations ['5f2c9088-e06a-4746-a122-588b57d00c7c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:54 devstack cinder-volume[84334]: WARNING cinder.quota [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1490252928 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1490252928, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:22:54 devstack cinder-volume[84334]: WARNING cinder.quota [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1490252928 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1490252928, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:22:54 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Created reservations ['f10118de-f33b-4d67-a1ca-ee01cdb78295', '7362bb4b-775b-4feb-9821-1f1de205bbab', '2d82f41e-6455-4f7b-b812-d48f214c6f75', 'abf803d6-68b1-41c0-b530-ae9ba820f3a9'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:54 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Created reservations ['53a415a1-c264-4061-a337-777031c4eeb8', '0da8225b-1155-4923-a670-bcda60795e61', '220df2c5-86e5-4a0b-8783-c6120d6b4eda', 'b7532c21-5449-4ff8-91d3-789e652b762c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.206s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:22:55 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:22:55 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-76fe8eb3-e6e3-4a55-951f-c2cbbcf73afc tempest-GroupsTest-1138779160 None] Delete group completed successfully. Sep 25 21:23:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:04 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:23:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Flow 'volume_create_manager' (53cb343c-a72b-4a59-bf78-e5c50203f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd0b1be-791e-47ff-abb4-d4f6f330ddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd0b1be-791e-47ff-abb4-d4f6f330ddd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-575039486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694ac134-d9e8-47e8-a001-87b5d1c056da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d7d3a2dafb45bdb8002274dcd59b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:04Z,use_quota=True,user_id='3d9a6424c34c4c589bd3b200d89e9f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c07fe0-085a-46eb-b809-27a27b3e8b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c07fe0-085a-46eb-b809-27a27b3e8b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5510d5bb-940b-4c58-86b8-e8a79e6b7600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5510d5bb-940b-4c58-86b8-e8a79e6b7600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694ac134-d9e8-47e8-a001-87b5d1c056da', 'volume_name': 'volume-694ac134-d9e8-47e8-a001-87b5d1c056da', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca5c026-71df-45b2-9e69-6680a3762da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca5c026-71df-45b2-9e69-6680a3762da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f386651-1210-425e-96d8-f3ab723b25a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume 694ac134-d9e8-47e8-a001-87b5d1c056da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694ac134-d9e8-47e8-a001-87b5d1c056da', 'volume_size': 1} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-575039486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694ac134-d9e8-47e8-a001-87b5d1c056da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d7d3a2dafb45bdb8002274dcd59b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:04Z,use_quota=True,user_id='3d9a6424c34c4c589bd3b200d89e9f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Creating volume 694ac134-d9e8-47e8-a001-87b5d1c056da {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:23:05 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:23:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:05 devstack quobyte-client[84349]: System call of process 91903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:05 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=20, name=volume-694ac134-d9e8-47e8-a001-87b5d1c056da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da 1073741824" returned: 0 in 0.603s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da" returned: 0 in 0.560s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] <== create_volume: return (1294ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f386651-1210-425e-96d8-f3ab723b25a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694ac134-d9e8-47e8-a001-87b5d1c056da', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba2e22f-1ea1-4485-8ae9-1cde77096e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume volume-694ac134-d9e8-47e8-a001-87b5d1c056da (694ac134-d9e8-47e8-a001-87b5d1c056da): created successfully Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba2e22f-1ea1-4485-8ae9-1cde77096e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Flow 'volume_create_manager' (53cb343c-a72b-4a59-bf78-e5c50203f72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-464e4df3-66aa-4fe1-abb6-f73f5b768d20 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Created volume successfully. Sep 25 21:23:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "cinder-694ac134-d9e8-47e8-a001-87b5d1c056da-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "cinder-694ac134-d9e8-47e8-a001-87b5d1c056da-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "cinder-quobyte-694ac134-d9e8-47e8-a001-87b5d1c056da" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "cinder-quobyte-694ac134-d9e8-47e8-a001-87b5d1c056da" acquired by "delete_volume" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8657e8-a4e9-4dbe-852f-fba3c5e9f82c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:08 devstack quobyte-client[84349]: System call of process 91926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:08 devstack quobyte-client[84349]: System call of process 91926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da" returned: 0 in 0.784s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-694ac134-d9e8-47e8-a001-87b5d1c056da" returned: 0 in 0.222s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "cinder-quobyte-694ac134-d9e8-47e8-a001-87b5d1c056da" released by "delete_volume" :: held 1.378s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:09 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Created reservations ['24ce1073-3175-4587-b5f6-6f37f0d30d57', 'baa672d5-904a-42d2-a43f-491bb1d9a24e', 'a0a80316-adb8-4546-b050-f4bdad02211e', '7a4857b0-5887-46d8-8ef8-a6a7e8f852f2'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.286s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:10 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:10 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Deleted volume successfully. Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ed604a7a-28bd-4028-9009-c8b2b2289619 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "cinder-694ac134-d9e8-47e8-a001-87b5d1c056da-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Flow 'volume_create_manager' (da4b25c7-f673-4823-a27f-40930b085ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90226ea-9f2a-439f-b9fd-d382df5f624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90226ea-9f2a-439f-b9fd-d382df5f624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-284875407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16316165-cc18-4325-9b2e-89f079391c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d7d3a2dafb45bdb8002274dcd59b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:11Z,use_quota=True,user_id='3d9a6424c34c4c589bd3b200d89e9f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae3f2af-c986-474f-9d7c-839e7dac719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae3f2af-c986-474f-9d7c-839e7dac719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4638a415-0bcf-4436-9f75-501f271b520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4638a415-0bcf-4436-9f75-501f271b520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16316165-cc18-4325-9b2e-89f079391c42', 'volume_name': 'volume-16316165-cc18-4325-9b2e-89f079391c42', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3c03b1-c7d1-4df7-b3cc-93de9a99f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3c03b1-c7d1-4df7-b3cc-93de9a99f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc8e82c-ae51-494a-a32d-c763817d69e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:11 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume 16316165-cc18-4325-9b2e-89f079391c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16316165-cc18-4325-9b2e-89f079391c42', 'volume_size': 1} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-284875407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16316165-cc18-4325-9b2e-89f079391c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d7d3a2dafb45bdb8002274dcd59b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:11Z,use_quota=True,user_id='3d9a6424c34c4c589bd3b200d89e9f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Creating volume 16316165-cc18-4325-9b2e-89f079391c42 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:23:11 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:23:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:12 devstack quobyte-client[84349]: System call of process 91950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:12 devstack quobyte-client[84349]: System call of process 91950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:12 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=21, name=volume-16316165-cc18-4325-9b2e-89f079391c42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:23:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42 1073741824" returned: 0 in 0.820s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42" returned: 0 in 0.129s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] <== create_volume: return (1117ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc8e82c-ae51-494a-a32d-c763817d69e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16316165-cc18-4325-9b2e-89f079391c42', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea5ce45-01ee-4fcd-9b24-a3a2bb322b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:13 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Volume volume-16316165-cc18-4325-9b2e-89f079391c42 (16316165-cc18-4325-9b2e-89f079391c42): created successfully Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea5ce45-01ee-4fcd-9b24-a3a2bb322b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Flow 'volume_create_manager' (da4b25c7-f673-4823-a27f-40930b085ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-efca496b-306a-4e16-af3a-59acc0674d19 tempest-VolumeQuotasAdminTestJSON-1631729546 None] Created volume successfully. Sep 25 21:23:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:15 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[00292a31-1c90-443f-b5e1-d1d856fccafd]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:15 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4a15a31b-2ccc-42eb-ae7f-afa79e7addcc tempest-VolumeQuotasAdminTestJSON-1643645237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4a15a31b-2ccc-42eb-ae7f-afa79e7addcc tempest-VolumeQuotasAdminTestJSON-1643645237 None] Transfer volume completed successfully. Sep 25 21:23:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" returned: 0 in 0.709s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7ccfb9b-aefc-4d84-bbea-1e5d3def5fbe', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:23:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-dabe0ae3-3f3e-4c7d-bb7b-22180d2f477a req-1f0133e6-a4aa-420f-9e49-4016edff4053 tempest-TaggedAttachmentsTest-606044682 None] attachment_update completed successfully. Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Acquiring lock "cinder-16316165-cc18-4325-9b2e-89f079391c42-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "cinder-16316165-cc18-4325-9b2e-89f079391c42-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Acquiring lock "cinder-quobyte-16316165-cc18-4325-9b2e-89f079391c42" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "cinder-quobyte-16316165-cc18-4325-9b2e-89f079391c42" acquired by "delete_volume" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232e98c-4d5d-49e3-944f-771ffb3e037a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42" returned: 0 in 0.711s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-16316165-cc18-4325-9b2e-89f079391c42" returned: 0 in 0.095s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "cinder-quobyte-16316165-cc18-4325-9b2e-89f079391c42" released by "delete_volume" :: held 0.998s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Created reservations ['70430589-5987-48f9-b385-e68f5f14a6ff', '2a469756-c286-458d-8736-0014c2de82fc', '35185a1d-9583-4635-8810-8e1a39bad943', '12005a6e-6dd3-4d97-89e2-f279b84b2d7c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.187s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Deleted volume successfully. Sep 25 21:23:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c3b5f860-10de-4cc4-ba10-bff70819ef8e tempest-VolumeQuotasAdminTestJSON-1757112140 None] Lock "cinder-16316165-cc18-4325-9b2e-89f079391c42-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:28 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=65,cinder:UPDATE=74,cinder:DELETE=2,cinder:INSERT=12 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:23:28 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=52,cinder:UPDATE=55,cinder:INSERT=11,cinder:DELETE=5 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:23:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Flow 'volume_create_manager' (cf2632f0-a08b-499f-bc95-97286379eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52028b-eb84-44ed-b4e1-16ada80c76ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52028b-eb84-44ed-b4e1-16ada80c76ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2099738759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6836def-945f-4cd3-80a2-c9480e6929e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74d1f7256654f8fa720e0978ea64fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:29Z,use_quota=True,user_id='86df5456b3f34887bb5b85dc775ad840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e77eb3c-d44d-48d4-b5d4-aecfee3840eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e77eb3c-d44d-48d4-b5d4-aecfee3840eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36dcf07-0e0b-4610-8b14-66533a9da69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36dcf07-0e0b-4610-8b14-66533a9da69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6836def-945f-4cd3-80a2-c9480e6929e4', 'volume_name': 'volume-f6836def-945f-4cd3-80a2-c9480e6929e4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2f5098-0405-4523-a7fe-e8e1b1c00c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2f5098-0405-4523-a7fe-e8e1b1c00c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009052f-c756-4a12-b6f2-394250848d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:29 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Volume f6836def-945f-4cd3-80a2-c9480e6929e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6836def-945f-4cd3-80a2-c9480e6929e4', 'volume_size': 1} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2099738759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6836def-945f-4cd3-80a2-c9480e6929e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74d1f7256654f8fa720e0978ea64fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:29Z,use_quota=True,user_id='86df5456b3f34887bb5b85dc775ad840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Creating volume f6836def-945f-4cd3-80a2-c9480e6929e4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:23:29 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:29 devstack quobyte-client[84349]: System call of process 92427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:29 devstack quobyte-client[84349]: System call of process 92427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:29 devstack quobyte-client[84349]: System call of process 92427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:29 devstack quobyte-client[84349]: System call of process 92427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:29 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=22, name=volume-f6836def-945f-4cd3-80a2-c9480e6929e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4 1073741824" returned: 0 in 0.376s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4" returned: 0 in 0.187s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] <== create_volume: return (628ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:23:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.642s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009052f-c756-4a12-b6f2-394250848d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6836def-945f-4cd3-80a2-c9480e6929e4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552cff96-c2f3-4f23-924b-641bbab44fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:30 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Volume volume-f6836def-945f-4cd3-80a2-c9480e6929e4 (f6836def-945f-4cd3-80a2-c9480e6929e4): created successfully Sep 25 21:23:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552cff96-c2f3-4f23-924b-641bbab44fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Flow 'volume_create_manager' (cf2632f0-a08b-499f-bc95-97286379eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e135a41e-620d-499f-89e1-1e790eebd668 tempest-VolumeQuotasNegativeTestJSON-863511563 None] Created volume successfully. Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Acquiring lock "cinder-f6836def-945f-4cd3-80a2-c9480e6929e4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "cinder-f6836def-945f-4cd3-80a2-c9480e6929e4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:32 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Acquiring lock "cinder-quobyte-f6836def-945f-4cd3-80a2-c9480e6929e4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "cinder-quobyte-f6836def-945f-4cd3-80a2-c9480e6929e4" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[db25295e-c84a-4da4-91f3-6fa718b457da]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4" returned: 0 in 0.408s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6836def-945f-4cd3-80a2-c9480e6929e4" returned: 0 in 0.088s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "cinder-quobyte-f6836def-945f-4cd3-80a2-c9480e6929e4" released by "delete_volume" :: held 0.652s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Created reservations ['e0a599d9-e816-4cb3-a141-3f04dcb63f5a', '588566fa-714b-4359-bbdd-d31d36ce458d', '0febb1fd-a707-46b2-8589-00c6e4aabe10', '769b41d2-f6ab-4b23-84b0-285d014b2935'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.098s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:33 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:33 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Deleted volume successfully. Sep 25 21:23:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-87200f8e-404a-4785-9d55-3d844e53394c tempest-VolumeQuotasNegativeTestJSON-863511563 None] Lock "cinder-f6836def-945f-4cd3-80a2-c9480e6929e4-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "cinder-602ca007-c8e6-4b36-9b6a-9c71755e8abe-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-602ca007-c8e6-4b36-9b6a-9c71755e8abe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "cinder-quobyte-602ca007-c8e6-4b36-9b6a-9c71755e8abe" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-quobyte-602ca007-c8e6-4b36-9b6a-9c71755e8abe" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c08a3-7bb2-411f-af19-0b8799fdbc3e]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe" returned: 0 in 0.535s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-602ca007-c8e6-4b36-9b6a-9c71755e8abe" returned: 0 in 0.121s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-quobyte-602ca007-c8e6-4b36-9b6a-9c71755e8abe" released by "delete_volume" :: held 0.876s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Created reservations ['9e70a680-9de2-4b54-927d-4efe43a3768a', '03e01795-f0b0-4ba8-b35b-eac53cba10e5', '1206a8a5-19e4-40cb-924a-cff2735b3ec4', '9f648dde-83df-409e-ab3c-ec5c7664bdb2'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Deleted volume successfully. Sep 25 21:23:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-920ea5df-9a6e-4bde-85b4-1dc21a5aa564 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-602ca007-c8e6-4b36-9b6a-9c71755e8abe-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.154s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "cinder-a1f729a1-31eb-4a1e-927d-1580fae8ff64-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-a1f729a1-31eb-4a1e-927d-1580fae8ff64-delete_volume" acquired by "delete_volume" :: waited 0.226s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Flow 'volume_create_manager' (edecd5ff-3fa2-459d-b9a9-fd2874ad2e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3821-8c8c-4e6d-853d-c6f8e89af408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3821-8c8c-4e6d-853d-c6f8e89af408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1721296398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd380780-3156-4f25-bfe4-7e64927ef8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b5b16e0c644878af01f14c1d0eeda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:40Z,use_quota=True,user_id='26c7da561bb2471594eaeb28127a18a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7cfb56-2646-4371-ac7d-d0d17a9ec1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7cfb56-2646-4371-ac7d-d0d17a9ec1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66735491-0305-4173-9f8f-44551629777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66735491-0305-4173-9f8f-44551629777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd380780-3156-4f25-bfe4-7e64927ef8cc', 'volume_name': 'volume-cd380780-3156-4f25-bfe4-7e64927ef8cc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e9c875-2e1a-4967-a37e-d5ade9c75383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e9c875-2e1a-4967-a37e-d5ade9c75383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea022d5c-7ea6-49dd-81af-876037a094dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:40 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Volume cd380780-3156-4f25-bfe4-7e64927ef8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd380780-3156-4f25-bfe4-7e64927ef8cc', 'volume_size': 1} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1721296398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd380780-3156-4f25-bfe4-7e64927ef8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b5b16e0c644878af01f14c1d0eeda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:23:40Z,use_quota=True,user_id='26c7da561bb2471594eaeb28127a18a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Creating volume cd380780-3156-4f25-bfe4-7e64927ef8cc {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:23:40 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:23:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:41 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=23, name=volume-cd380780-3156-4f25-bfe4-7e64927ef8cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:23:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "cinder-quobyte-a1f729a1-31eb-4a1e-927d-1580fae8ff64" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-quobyte-a1f729a1-31eb-4a1e-927d-1580fae8ff64" acquired by "delete_volume" :: waited 0.063s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0c049-e14a-43bb-9104-fcfe40d4d605]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc 1073741824" returned: 0 in 0.495s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc" returned: 0 in 0.161s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] <== create_volume: return (743ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:41 devstack quobyte-client[84349]: System call of process 92480 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea022d5c-7ea6-49dd-81af-876037a094dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd380780-3156-4f25-bfe4-7e64927ef8cc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc512257-bc26-4ffe-a66c-12e0ff6bdd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64" returned: 0 in 0.591s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Volume volume-cd380780-3156-4f25-bfe4-7e64927ef8cc (cd380780-3156-4f25-bfe4-7e64927ef8cc): created successfully Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc512257-bc26-4ffe-a66c-12e0ff6bdd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Flow 'volume_create_manager' (edecd5ff-3fa2-459d-b9a9-fd2874ad2e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a1f729a1-31eb-4a1e-927d-1580fae8ff64" returned: 0 in 0.285s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-6cb52b10-be4a-41a1-a2d8-5e8d8ec2ca4d tempest-VolumesServicesTestJSON-1406196560 None] Created volume successfully. Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-quobyte-a1f729a1-31eb-4a1e-927d-1580fae8ff64" released by "delete_volume" :: held 1.010s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Created reservations ['c29cd65d-c88a-4131-b48d-10b2503b9601', '05b16401-fe00-44e9-b854-a207346f8b15', '5167f040-cf8a-45cb-829e-ad42f67df7f2', '9ae8b621-7100-479b-ab49-908075794ea8'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Deleted volume successfully. Sep 25 21:23:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dc94e629-ad91-4008-8026-c62aa22b8472 tempest-AttachVolumeShelveTestJSON-711361392 None] Lock "cinder-a1f729a1-31eb-4a1e-927d-1580fae8ff64-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Acquiring lock "cinder-cd380780-3156-4f25-bfe4-7e64927ef8cc-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "cinder-cd380780-3156-4f25-bfe4-7e64927ef8cc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Acquiring lock "cinder-quobyte-cd380780-3156-4f25-bfe4-7e64927ef8cc" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "cinder-quobyte-cd380780-3156-4f25-bfe4-7e64927ef8cc" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[63037260-3485-4683-9a02-77259b37400d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:43 devstack quobyte-client[84349]: System call of process 92487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:43 devstack quobyte-client[84349]: System call of process 92487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc" returned: 0 in 0.474s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-cd380780-3156-4f25-bfe4-7e64927ef8cc" returned: 0 in 0.129s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "cinder-quobyte-cd380780-3156-4f25-bfe4-7e64927ef8cc" released by "delete_volume" :: held 0.782s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Created reservations ['e4a18f9d-60c5-4f01-839a-314e2f637760', 'a7e5c56f-8858-4d9c-bdd8-5cbc601668fa', 'ccc0bfbe-bf2c-4f09-b1dd-4bc4c46f820e', 'e820b7fe-715e-4fe4-ba2e-267da8c61c62'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:23:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Deleted volume successfully. Sep 25 21:23:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4b50f73-4251-40b4-b60f-fdd62cb3e16e tempest-VolumesServicesTestJSON-1406196560 None] Lock "cinder-cd380780-3156-4f25-bfe4-7e64927ef8cc-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:23:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-e650694a-7a1a-4e8d-aa02-5353dbb48a0d req-6f545511-c84f-43d3-aaf0-e60b3b0c1be0 tempest-TaggedAttachmentsTest-606044682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-e650694a-7a1a-4e8d-aa02-5353dbb48a0d req-6f545511-c84f-43d3-aaf0-e60b3b0c1be0 tempest-TaggedAttachmentsTest-606044682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:23:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-e650694a-7a1a-4e8d-aa02-5353dbb48a0d req-6f545511-c84f-43d3-aaf0-e60b3b0c1be0 tempest-TaggedAttachmentsTest-606044682 None] Terminate volume connection completed successfully. Sep 25 21:23:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-e650694a-7a1a-4e8d-aa02-5353dbb48a0d req-6f545511-c84f-43d3-aaf0-e60b3b0c1be0 tempest-TaggedAttachmentsTest-606044682 None] Deleting attachment f7ccfb9b-aefc-4d84-bbea-1e5d3def5fbe. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:23:58 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=54,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:23:58 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=7 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:24:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (107683ac-11cf-437e-977c-9875ab9e9658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f9b14c-54f4-4860-8136-42688078bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f9b14c-54f4-4860-8136-42688078bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-322875001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce633d8e-704f-4757-8f0a-1e822a962bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:06Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed422b7a-ccdf-4bf1-a133-3db1b3b802eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed422b7a-ccdf-4bf1-a133-3db1b3b802eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d867bfe3-a3c4-40a0-878c-28ca86aacfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d867bfe3-a3c4-40a0-878c-28ca86aacfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce633d8e-704f-4757-8f0a-1e822a962bbf', 'volume_name': 'volume-ce633d8e-704f-4757-8f0a-1e822a962bbf', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45071a2-84a9-424d-b075-c72e081ce558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45071a2-84a9-424d-b075-c72e081ce558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a48937-45aa-4eac-af15-1051eaeb2e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Volume ce633d8e-704f-4757-8f0a-1e822a962bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce633d8e-704f-4757-8f0a-1e822a962bbf', 'volume_size': 1} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-322875001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce633d8e-704f-4757-8f0a-1e822a962bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:06Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Creating volume ce633d8e-704f-4757-8f0a-1e822a962bbf {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:24:06 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:06 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=24, name=volume-ce633d8e-704f-4757-8f0a-1e822a962bbf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf 1073741824" returned: 0 in 0.359s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf" returned: 0 in 0.088s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] <== create_volume: return (517ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a48937-45aa-4eac-af15-1051eaeb2e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce633d8e-704f-4757-8f0a-1e822a962bbf', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf90074-2400-4478-a904-6c562177fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Volume volume-ce633d8e-704f-4757-8f0a-1e822a962bbf (ce633d8e-704f-4757-8f0a-1e822a962bbf): created successfully Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf90074-2400-4478-a904-6c562177fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (107683ac-11cf-437e-977c-9875ab9e9658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8212e677-14fe-4bef-8fc6-6caa7b10e9fc tempest-VolumesListAdminTestJSON-1360048832 None] Created volume successfully. Sep 25 21:24:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (58fddb2d-1aba-4659-9de6-e8f9a62ec237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafa608a-f4c5-42bc-bcf8-760bab2296d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafa608a-f4c5-42bc-bcf8-760bab2296d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-811444314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26255ebf-909a-4ca1-80d3-00a8b905c4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:08Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a57294-fcb8-4961-8d2f-e0a6931d9415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a57294-fcb8-4961-8d2f-e0a6931d9415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20fd396-84a5-4344-a6dc-0c36f470bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20fd396-84a5-4344-a6dc-0c36f470bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26255ebf-909a-4ca1-80d3-00a8b905c4df', 'volume_name': 'volume-26255ebf-909a-4ca1-80d3-00a8b905c4df', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbd930f-e686-4b2e-b184-0267cbcbe2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbd930f-e686-4b2e-b184-0267cbcbe2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc4f67e-d9ff-4993-a023-d21de7aca963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Volume 26255ebf-909a-4ca1-80d3-00a8b905c4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26255ebf-909a-4ca1-80d3-00a8b905c4df', 'volume_size': 1} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-811444314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26255ebf-909a-4ca1-80d3-00a8b905c4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:08Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Creating volume 26255ebf-909a-4ca1-80d3-00a8b905c4df {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:24:08 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:24:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:08 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=25, name=volume-26255ebf-909a-4ca1-80d3-00a8b905c4df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df 1073741824" returned: 0 in 0.351s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df" returned: 0 in 0.268s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] <== create_volume: return (749ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc4f67e-d9ff-4993-a023-d21de7aca963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26255ebf-909a-4ca1-80d3-00a8b905c4df', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b765bf2a-3490-4052-9dad-456068b43df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:09 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Volume volume-26255ebf-909a-4ca1-80d3-00a8b905c4df (26255ebf-909a-4ca1-80d3-00a8b905c4df): created successfully Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b765bf2a-3490-4052-9dad-456068b43df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (58fddb2d-1aba-4659-9de6-e8f9a62ec237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:09 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7ca324e2-6372-4508-a631-19a66e5cc4be tempest-VolumesListAdminTestJSON-1360048832 None] Created volume successfully. Sep 25 21:24:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (5c48063d-d156-44fc-bcf1-95d1bdf567b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26309ec4-c05d-458f-9a2f-2e736b43678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26309ec4-c05d-458f-9a2f-2e736b43678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-686509218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea6b78-236c-4120-be4e-c9093f9b5997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:11Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9810da15-5f1c-4c16-814f-fc1f6caf8ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9810da15-5f1c-4c16-814f-fc1f6caf8ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f0d253-e003-49fd-a1a9-c058c2fa6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f0d253-e003-49fd-a1a9-c058c2fa6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ea6b78-236c-4120-be4e-c9093f9b5997', 'volume_name': 'volume-57ea6b78-236c-4120-be4e-c9093f9b5997', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1af84-7584-4bca-a43e-49be5edef7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1af84-7584-4bca-a43e-49be5edef7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739ce1bd-88e4-4d55-a439-b87d4ecca222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:11 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Volume 57ea6b78-236c-4120-be4e-c9093f9b5997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ea6b78-236c-4120-be4e-c9093f9b5997', 'volume_size': 1} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-686509218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea6b78-236c-4120-be4e-c9093f9b5997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689698aa851480da5005da3262514ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:11Z,use_quota=True,user_id='72fe57104b40410fb9c5c8ee9abd4f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Creating volume 57ea6b78-236c-4120-be4e-c9093f9b5997 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:24:11 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:11 devstack quobyte-client[84349]: System call of process 92570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:11 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=26, name=volume-57ea6b78-236c-4120-be4e-c9093f9b5997, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997 1073741824" returned: 0 in 0.384s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997" returned: 0 in 0.284s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739ce1bd-88e4-4d55-a439-b87d4ecca222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ea6b78-236c-4120-be4e-c9093f9b5997', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a7dc84-87cf-41b3-a1bf-2771da7e3065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Volume volume-57ea6b78-236c-4120-be4e-c9093f9b5997 (57ea6b78-236c-4120-be4e-c9093f9b5997): created successfully Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a7dc84-87cf-41b3-a1bf-2771da7e3065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Flow 'volume_create_manager' (5c48063d-d156-44fc-bcf1-95d1bdf567b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ba549f0a-5ed9-4e30-b067-9415499e5fef tempest-VolumesListAdminTestJSON-1360048832 None] Created volume successfully. Sep 25 21:24:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Flow 'volume_create_manager' (6fbc29e0-65ea-40dd-a53e-fd5980e73fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e021e9-8e6b-41b6-aa3d-79b0358fbc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e021e9-8e6b-41b6-aa3d-79b0358fbc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47835bb2-30b9-4a0d-b74c-c46f758b9a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f5066d4760460b929c92efb3ba178a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:14Z,use_quota=True,user_id='5b5b6fdfa43c43438f6b7dda4328e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4732d1fc-cb50-4f76-b4f4-456ad5061af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4732d1fc-cb50-4f76-b4f4-456ad5061af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27ffd21-5aca-431f-b0bd-6c4fecb1131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27ffd21-5aca-431f-b0bd-6c4fecb1131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47835bb2-30b9-4a0d-b74c-c46f758b9a0e', 'volume_name': 'volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92438318-4267-4e58-b920-9d0833157fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92438318-4267-4e58-b920-9d0833157fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345944f2-990c-44a7-a391-1caaf3c28f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:14 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Volume 47835bb2-30b9-4a0d-b74c-c46f758b9a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e', 'volume_size': 1} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47835bb2-30b9-4a0d-b74c-c46f758b9a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f5066d4760460b929c92efb3ba178a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:14Z,use_quota=True,user_id='5b5b6fdfa43c43438f6b7dda4328e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Creating volume 47835bb2-30b9-4a0d-b74c-c46f758b9a0e {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:24:14 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:24:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:15 devstack quobyte-client[84349]: System call of process 92580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:15 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=27, name=volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e 1073741824" returned: 0 in 0.604s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" returned: 0 in 0.173s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] <== create_volume: return (1060ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:24:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345944f2-990c-44a7-a391-1caaf3c28f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098a8f23-ec2f-46f2-ad7c-7e32f89315bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:16 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Volume volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e (47835bb2-30b9-4a0d-b74c-c46f758b9a0e): created successfully Sep 25 21:24:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098a8f23-ec2f-46f2-ad7c-7e32f89315bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Flow 'volume_create_manager' (6fbc29e0-65ea-40dd-a53e-fd5980e73fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-02cb8c8b-0b4d-4cba-8b43-541b04e85915 tempest-VolumesListAdminTestJSON-594742789 None] Created volume successfully. Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Acquiring lock "cinder-47835bb2-30b9-4a0d-b74c-c46f758b9a0e-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "cinder-47835bb2-30b9-4a0d-b74c-c46f758b9a0e-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-57ea6b78-236c-4120-be4e-c9093f9b5997-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Acquiring lock "cinder-quobyte-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-57ea6b78-236c-4120-be4e-c9093f9b5997-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "cinder-quobyte-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" acquired by "delete_volume" :: waited 0.034s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f123612-d962-4070-8324-b2337f79c491]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-quobyte-57ea6b78-236c-4120-be4e-c9093f9b5997" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-57ea6b78-236c-4120-be4e-c9093f9b5997" acquired by "delete_volume" :: waited 0.060s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b5420-c041-4553-9b13-6bb6429863f9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" returned: 0 in 0.930s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" returned: 0 in 0.146s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "cinder-quobyte-47835bb2-30b9-4a0d-b74c-c46f758b9a0e" released by "delete_volume" :: held 1.284s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:18 devstack quobyte-client[84349]: System call of process 92597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997" returned: 0 in 0.645s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-57ea6b78-236c-4120-be4e-c9093f9b5997" returned: 0 in 0.271s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-57ea6b78-236c-4120-be4e-c9093f9b5997" released by "delete_volume" :: held 1.083s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Created reservations ['009ff50f-d609-49d5-af79-627fb2c49c7a', '6199b494-4b9e-4278-99b8-44555af96165', 'db91e186-7325-41dc-b3c1-f3a4107f03d2', 'e6c07406-aa4b-479a-9067-eaf60f585068'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Created reservations ['e61976b7-a37e-4022-899e-728fe5aaaf5d', '98f84b21-32f7-49cb-b737-fb66d4f41916', 'de8ca7b2-84d7-4219-87b6-e7ed385896b6', 'bca0156a-aa07-4c92-bed2-de0bd0f44e20'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.337s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Deleted volume successfully. Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-391b653f-296e-4d65-9a7e-22083ed7d133 tempest-VolumesListAdminTestJSON-594742789 None] Lock "cinder-47835bb2-30b9-4a0d-b74c-c46f758b9a0e-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.144s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:20 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Deleted volume successfully. Sep 25 21:24:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-28324014-9f00-4df1-873f-055e2f9ba0eb tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-57ea6b78-236c-4120-be4e-c9093f9b5997-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-26255ebf-909a-4ca1-80d3-00a8b905c4df-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-26255ebf-909a-4ca1-80d3-00a8b905c4df-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:21 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-quobyte-26255ebf-909a-4ca1-80d3-00a8b905c4df" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-26255ebf-909a-4ca1-80d3-00a8b905c4df" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a863b-1910-4a03-a131-dffebd99d542]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:21 devstack quobyte-client[84349]: System call of process 92609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:21 devstack quobyte-client[84349]: System call of process 92609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:21 devstack quobyte-client[84349]: System call of process 92609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df" returned: 0 in 0.837s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-26255ebf-909a-4ca1-80d3-00a8b905c4df" returned: 0 in 0.603s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-26255ebf-909a-4ca1-80d3-00a8b905c4df" released by "delete_volume" :: held 1.816s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Created reservations ['4755956d-8a06-4f4c-bfe3-8a7d1614822f', 'fa204ded-08b8-475e-b086-435d47ea2de3', 'b971ad51-b482-41c1-88c9-568ee4c8878d', '3fc5aee8-e3e5-469e-b33c-3c5dcd95850d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.206s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:23 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Deleted volume successfully. Sep 25 21:24:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-744e173e-0550-4dab-b0fb-d132da12d319 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-26255ebf-909a-4ca1-80d3-00a8b905c4df-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-ce633d8e-704f-4757-8f0a-1e822a962bbf-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-ce633d8e-704f-4757-8f0a-1e822a962bbf-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "cinder-quobyte-ce633d8e-704f-4757-8f0a-1e822a962bbf" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-ce633d8e-704f-4757-8f0a-1e822a962bbf" acquired by "delete_volume" :: waited 0.019s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab4bd3a-7fa8-4e1c-a9ba-13f557b3406f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:26 devstack quobyte-client[84349]: System call of process 92686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:26 devstack quobyte-client[84349]: System call of process 92686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:26 devstack quobyte-client[84349]: System call of process 92686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:26 devstack quobyte-client[84349]: System call of process 92686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf" returned: 0 in 1.406s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce633d8e-704f-4757-8f0a-1e822a962bbf" returned: 0 in 0.521s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-quobyte-ce633d8e-704f-4757-8f0a-1e822a962bbf" released by "delete_volume" :: held 2.421s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Created reservations ['898c4d8b-b605-4044-aac1-574836448f9f', '95f027e4-7cf1-413d-8395-3790fd8cf7f1', '8b20e587-90ce-45af-8ab2-7a1aa79f978e', '2de5e4a2-cccd-463e-bdeb-25d92af419d7'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.262s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:29 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Deleted volume successfully. Sep 25 21:24:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-fd4346f9-f01c-45b6-bc0e-bc821dcda192 tempest-VolumesListAdminTestJSON-1360048832 None] Lock "cinder-ce633d8e-704f-4757-8f0a-1e822a962bbf-delete_volume" released by "delete_volume" :: held 5.398s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "cinder-0dd9d00d-0408-4b8b-86c6-08d1fe34497e-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "cinder-0dd9d00d-0408-4b8b-86c6-08d1fe34497e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "cinder-quobyte-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:24:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "cinder-quobyte-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" acquired by "delete_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:24:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[09364763-8dfa-4c0f-90f3-8cdbb8e70fab]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" returned: 0 in 1.107s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" returned: 0 in 0.179s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "cinder-quobyte-0dd9d00d-0408-4b8b-86c6-08d1fe34497e" released by "delete_volume" :: held 1.591s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Created reservations ['457603a3-893e-4350-ab0c-2a5d7fb1cbae', 'e0a96f28-e60a-4a23-a294-54f9d37c221f', 'f69d1260-78c0-4d3a-abc4-8a6d98cc13f3', 'c7de5604-9f8d-4e94-90a2-9f70a69b3aa8'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.276s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.337s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:24:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Deleted volume successfully. Sep 25 21:24:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-72113926-0a53-450a-a8db-6a8b7493e260 tempest-TaggedAttachmentsTest-606044682 None] Lock "cinder-0dd9d00d-0408-4b8b-86c6-08d1fe34497e-delete_volume" released by "delete_volume" :: held 4.403s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:24:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Flow 'volume_create_manager' (5c95ff04-11c1-42d9-a9be-3c13c221fb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f9fbb9-35b1-46d6-80be-c633cab448ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f9fbb9-35b1-46d6-80be-c633cab448ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2143311225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d718f0-486b-4c30-8030-dadf86151fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd244bad25374bc4a21e929d7f60de3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:43Z,use_quota=True,user_id='467e171c8ab948aa9ab9b2b332a90848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba73ff6-dd94-43fb-9ac3-dd8984209400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba73ff6-dd94-43fb-9ac3-dd8984209400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddffec7f-f64f-4b43-9082-0334042d2f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:43 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:24:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddffec7f-f64f-4b43-9082-0334042d2f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87d718f0-486b-4c30-8030-dadf86151fb6', 'volume_name': 'volume-87d718f0-486b-4c30-8030-dadf86151fb6', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6300603-40da-47a1-8662-195f3c956b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6300603-40da-47a1-8662-195f3c956b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f27e6-4106-4d23-a0eb-8181d021af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:24:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Volume 87d718f0-486b-4c30-8030-dadf86151fb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87d718f0-486b-4c30-8030-dadf86151fb6', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:24:44 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Cloning 87d718f0-486b-4c30-8030-dadf86151fb6 from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b at location (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:24:45 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:24:45 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Image download 20.69 MB at 20.56 MB/s Sep 25 21:24:45 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1314e18-76b3-40b4-abd7-db698594fdca]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:46 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD Sep 25 21:24:46 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:24:48 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 25 21:24:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD" returned: 0 in 2.995s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:48 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b is fetched for user 467e171c8ab948aa9ab9b2b332a90848. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:24:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[383d51ba-1c38-429c-b4c4-8db220c6e74b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:49 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD Sep 25 21:24:49 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:24:51 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD" returned: 0 in 2.800s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2143311225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d718f0-486b-4c30-8030-dadf86151fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd244bad25374bc4a21e929d7f60de3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:24:43Z,use_quota=True,user_id='467e171c8ab948aa9ab9b2b332a90848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Creating volume 87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:24:52 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:52 devstack quobyte-client[84349]: System call of process 92786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:52 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=28, name=volume-87d718f0-486b-4c30-8030-dadf86151fb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 1073741824" returned: 0 in 0.508s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 0 in 0.210s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:24:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:24:53 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Attempting download of 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 87d718f0-486b-4c30-8030-dadf86151fb6. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:24:53 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b933652-79b5-41ac-812c-6b587772ff91]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_9zjnji2o {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_9zjnji2o" returned: 0 in 0.835s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_9zjnji2o {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_9zjnji2o" returned: 1 in 0.534s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_9zjnji2o' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a5ef6a-cc8a-4edf-9522-648e955bf3a2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:55 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b was qcow2, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:24:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:55 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=28, name=volume-87d718f0-486b-4c30-8030-dadf86151fb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:24:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 0 in 1.931s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:57 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_913a6plodevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:24:57 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Converted 112.00 MB image at 56.57 MB/s Sep 25 21:24:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:57 devstack quobyte-client[84349]: System call of process 92836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:57 devstack quobyte-client[84349]: System call of process 92836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:57 devstack quobyte-client[84349]: System call of process 92836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 1G" returned: 0 in 0.355s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:58 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3eb7c-d78f-473d-b817-494e59ee41d1]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:24:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:58 devstack quobyte-client[84349]: System call of process 92839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:58 devstack quobyte-client[84349]: System call of process 92839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:58 devstack quobyte-client[84349]: System call of process 92839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 0 in 0.673s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=28,cinder:UPDATE=49,cinder:DELETE=8,cinder:INSERT=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:24:59 devstack quobyte-client[84349]: System call of process 92843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 1 in 0.758s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Downloaded image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 87d718f0-486b-4c30-8030-dadf86151fb6 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b for user 467e171c8ab948aa9ab9b2b332a90848 is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Marking volume 87d718f0-486b-4c30-8030-dadf86151fb6 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=34,cinder:UPDATE=51,cinder:INSERT=15,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Copying metadata from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b to 87d718f0-486b-4c30-8030-dadf86151fb6. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Creating volume glance metadata for volume 87d718f0-486b-4c30-8030-dadf86151fb6 backed by image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f27e6-4106-4d23-a0eb-8181d021af39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d718f0-486b-4c30-8030-dadf86151fb6', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:24:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e85e7d-60b0-40ce-8ec9-a13e2c098655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Volume volume-87d718f0-486b-4c30-8030-dadf86151fb6 (87d718f0-486b-4c30-8030-dadf86151fb6): created successfully Sep 25 21:25:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e85e7d-60b0-40ce-8ec9-a13e2c098655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Flow 'volume_create_manager' (5c95ff04-11c1-42d9-a9be-3c13c221fb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b5456202-7683-4ef8-995e-12b117049402 tempest-VolumesImageMetadata-2109573791 None] Created volume successfully. Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Acquiring lock "cinder-87d718f0-486b-4c30-8030-dadf86151fb6-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "cinder-87d718f0-486b-4c30-8030-dadf86151fb6-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Acquiring lock "cinder-quobyte-87d718f0-486b-4c30-8030-dadf86151fb6" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "cinder-quobyte-87d718f0-486b-4c30-8030-dadf86151fb6" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e7436-bab2-45f4-baed-693d620b36e8]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:02 devstack quobyte-client[84349]: System call of process 92849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:02 devstack quobyte-client[84349]: System call of process 92849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 0 in 0.562s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 1 in 0.512s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87d718f0-486b-4c30-8030-dadf86151fb6" returned: 0 in 0.174s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "cinder-quobyte-87d718f0-486b-4c30-8030-dadf86151fb6" released by "delete_volume" :: held 1.558s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Created reservations ['4fa11fb6-81d7-4ae2-b666-d13c5f308b06', 'f91d46c6-c163-4ded-afe1-a1ceef0d335b', 'bff33233-4ffc-4da6-953a-176a67797942', '30c516e4-cc3d-461a-b029-09f3e54b89b6'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.408s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Deleted volume successfully. Sep 25 21:25:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Flow 'volume_create_manager' (98935ab6-aef5-4406-bf20-82dc7b39e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a666c4f-70f9-44e0-b0d0-8a6cab15c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a666c4f-70f9-44e0-b0d0-8a6cab15c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-520288757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7dd46e-438a-4d66-8d99-fe1216204188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ee4c23b904b4bb92e2e8e53431ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:04Z,use_quota=True,user_id='d42d2faee0ea42ff80a2eaa5c35847b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15328d1-efdb-4fa5-b49a-0c8ae81dba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15328d1-efdb-4fa5-b49a-0c8ae81dba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d0f7b-6b50-42c3-977d-698ba1634881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d0f7b-6b50-42c3-977d-698ba1634881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7dd46e-438a-4d66-8d99-fe1216204188', 'volume_name': 'volume-8a7dd46e-438a-4d66-8d99-fe1216204188', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3629ed-4f7d-44a3-a3c3-aa579782c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3629ed-4f7d-44a3-a3c3-aa579782c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1739b06a-9979-499c-884d-e64e080e36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:04 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume 8a7dd46e-438a-4d66-8d99-fe1216204188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7dd46e-438a-4d66-8d99-fe1216204188', 'volume_size': 1} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-520288757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7dd46e-438a-4d66-8d99-fe1216204188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ee4c23b904b4bb92e2e8e53431ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:04Z,use_quota=True,user_id='d42d2faee0ea42ff80a2eaa5c35847b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Creating volume 8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:04 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:04 devstack quobyte-client[84349]: System call of process 92862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:04 devstack quobyte-client[84349]: System call of process 92862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:04 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=29, name=volume-8a7dd46e-438a-4d66-8d99-fe1216204188, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff9daff3-8bc1-457a-a685-1baae1aea601 tempest-VolumesImageMetadata-2109573791 None] Lock "cinder-87d718f0-486b-4c30-8030-dadf86151fb6-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 1073741824" returned: 0 in 0.409s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188" returned: 0 in 0.145s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1739b06a-9979-499c-884d-e64e080e36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7dd46e-438a-4d66-8d99-fe1216204188', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fd9129-9426-4bd1-b3a2-953ce60b66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume volume-8a7dd46e-438a-4d66-8d99-fe1216204188 (8a7dd46e-438a-4d66-8d99-fe1216204188): created successfully Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fd9129-9426-4bd1-b3a2-953ce60b66cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Flow 'volume_create_manager' (98935ab6-aef5-4406-bf20-82dc7b39e74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-16a85c11-3c66-4074-ab08-d65623c7a487 req-ef7ff15e-0846-457d-a14a-4765ea60cfe7 tempest-VolumesSnapshotsTestJSON-203290213 None] Created volume successfully. Sep 25 21:25:06 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Creating offline snapshot d0d477b4-3e79-41b5-bda4-02a7418af34b of volume 8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[558df2ca-fc3d-45ce-a3c1-148add6d1133]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188" returned: 0 in 0.487s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:07 devstack quobyte-client[84349]: System call of process 92878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:07 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=30, name=volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b 1G" returned: 0 in 0.331s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8a7dd46e-438a-4d66-8d99-fe1216204188 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:08 devstack quobyte-client[84349]: System call of process 92881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "qemu-img rebase -u -b volume-8a7dd46e-438a-4d66-8d99-fe1216204188 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 0.240s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 0.172s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 0.185s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.info" returned: 0 in 0.176s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:25:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.info" returned: 0 in 0.518s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:10 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-061edf20-208f-4694-acae-4d451b6f494a req-c54a32a9-437b-43a7-889e-4a3c6b8b6b35 tempest-VolumesSnapshotsTestJSON-203290213 None] Create snapshot completed successfully Sep 25 21:25:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "cinder-d0d477b4-3e79-41b5-bda4-02a7418af34b-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-d0d477b4-3e79-41b5-bda4-02a7418af34b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "cinder-quobyte-d0d477b4-3e79-41b5-bda4-02a7418af34b" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-d0d477b4-3e79-41b5-bda4-02a7418af34b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Deleting offline snapshot d0d477b4-3e79-41b5-bda4-02a7418af34b of volume 8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] snapshot_file for this snap is: volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aacd3fe-d435-4bc1-afe2-c06630ef3fda]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:12 devstack quobyte-client[84349]: System call of process 93063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:12 devstack quobyte-client[84349]: System call of process 93063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:12 devstack quobyte-client[84349]: System call of process 93063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Flow 'volume_create_manager' (888f3844-f7d3-471b-918a-0101f4ae4dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329b592-76df-448d-b6a0-1978085a1949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 1.221s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329b592-76df-448d-b6a0-1978085a1949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-66977726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21258145-5241-42c1-be70-e4de860a0e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e69eeca14141b1a4a810d6045d88c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:11Z,use_quota=True,user_id='30020419b75541dca4a29c7cd0fd77a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbfb41a-cdeb-4b6b-89bc-9c0088245bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbfb41a-cdeb-4b6b-89bc-9c0088245bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bf1bc6-6ef4-49ad-8cdf-5f0fe8edf829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bf1bc6-6ef4-49ad-8cdf-5f0fe8edf829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21258145-5241-42c1-be70-e4de860a0e69', 'volume_name': 'volume-21258145-5241-42c1-be70-e4de860a0e69', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4661049b-5c17-4db6-a9ac-6e7d031a6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4661049b-5c17-4db6-a9ac-6e7d031a6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df080e08-764b-4501-866d-06de9fec9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Volume 21258145-5241-42c1-be70-e4de860a0e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21258145-5241-42c1-be70-e4de860a0e69', 'volume_size': 1} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-66977726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21258145-5241-42c1-be70-e4de860a0e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e69eeca14141b1a4a810d6045d88c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:11Z,use_quota=True,user_id='30020419b75541dca4a29c7cd0fd77a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Creating volume 21258145-5241-42c1-be70-e4de860a0e69 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:12 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a7dd46e-438a-4d66-8d99-fe1216204188(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:25:12 devstack quobyte-client[84349]: System call of process 93123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:12 devstack quobyte-client[84349]: System call of process 93123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:12 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=32, name=volume-21258145-5241-42c1-be70-e4de860a0e69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155fe62-b422-48db-b8a0-0963a738ebee]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69 1073741824" returned: 0 in 0.570s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69" returned: 0 in 0.313s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] <== create_volume: return (1054ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:13 devstack quobyte-client[84349]: System call of process 93128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:13 devstack quobyte-client[84349]: System call of process 93128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188" returned: 0 in 1.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:14 devstack quobyte-client[84349]: System call of process 93133 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df080e08-764b-4501-866d-06de9fec9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21258145-5241-42c1-be70-e4de860a0e69', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1311901c-bf63-416c-a567-85ba3b18fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 0.672s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:14 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Volume volume-21258145-5241-42c1-be70-e4de860a0e69 (21258145-5241-42c1-be70-e4de860a0e69): created successfully Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1311901c-bf63-416c-a567-85ba3b18fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Flow 'volume_create_manager' (888f3844-f7d3-471b-918a-0101f4ae4dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188.d0d477b4-3e79-41b5-bda4-02a7418af34b" returned: 0 in 0.338s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-d0d477b4-3e79-41b5-bda4-02a7418af34b" released by "_delete_snapshot" :: held 3.997s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8f6f1ab6-a5d2-4073-9add-e1a6186ef1b6 tempest-AbsoluteLimitsTests-38428319 None] Created volume successfully. Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" released by "delete_snapshot" :: held 4.046s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:15 devstack cinder-volume[84334]: WARNING cinder.quota [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.quota [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Created reservations ['53eb1b08-ac13-4f96-8148-1a10e97e7901', '89ffab15-d858-46b5-b2ad-52e8b4877339', 'c34f75f5-0717-4331-8c0e-51f19025229c', 'd05e7407-b732-4c41-ace0-b8439c782c59'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Delete snapshot completed successfully. Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-664cf91e-5f2c-4ab9-be94-0a63e237dbd7 req-73292b68-a123-4b8d-86b5-305c5733977d tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-d0d477b4-3e79-41b5-bda4-02a7418af34b-delete_snapshot" released by "delete_snapshot" :: held 4.440s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "cinder-8a7dd46e-438a-4d66-8d99-fe1216204188-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-8a7dd46e-438a-4d66-8d99-fe1216204188-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" acquired by "delete_volume" :: waited 0.016s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[12697f02-9fc0-4106-b6e3-68db73015ddb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Acquiring lock "cinder-21258145-5241-42c1-be70-e4de860a0e69-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "cinder-21258145-5241-42c1-be70-e4de860a0e69-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:16 devstack quobyte-client[84349]: System call of process 93137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188" returned: 0 in 0.701s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8a7dd46e-438a-4d66-8d99-fe1216204188" returned: 0 in 0.326s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Acquiring lock "cinder-quobyte-21258145-5241-42c1-be70-e4de860a0e69" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-quobyte-8a7dd46e-438a-4d66-8d99-fe1216204188" released by "delete_volume" :: held 1.182s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "cinder-quobyte-21258145-5241-42c1-be70-e4de860a0e69" acquired by "delete_volume" :: waited 0.049s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fb944-7882-437b-b98a-a06703f7dd32]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.quota [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Created reservations ['bb97a650-7437-4f81-b008-72d0c4763ba2', 'f668585c-0bfb-43fc-82c5-b2caa5f94621', '9c028b38-4b2b-4bdf-8ef9-684869533a5c', 'aed2c14f-0ad9-4869-b2fd-d2c5c0f11b1d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:17 devstack quobyte-client[84349]: System call of process 93141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69" returned: 0 in 0.636s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.169s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.manager [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Deleted volume successfully. Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-21258145-5241-42c1-be70-e4de860a0e69" returned: 0 in 0.358s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "cinder-quobyte-21258145-5241-42c1-be70-e4de860a0e69" released by "delete_volume" :: held 1.172s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-2efb0a14-178b-43a6-9edd-2076bb7af6fb req-017285a0-788d-4c57-b7ce-6456608bb195 tempest-VolumesSnapshotsTestJSON-203290213 None] Lock "cinder-8a7dd46e-438a-4d66-8d99-fe1216204188-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Created reservations ['8eb6402d-664c-4e2a-93b3-84ce3b26fd42', 'bdbb732f-ee02-431d-99fb-ef1525e235eb', 'b5c833a2-fa33-4fe2-b9b3-3f661b78578e', '0529fe82-146d-4f4e-b09f-4bf4f9062cdc'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.094s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:18 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Deleted volume successfully. Sep 25 21:25:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-521ebb0f-e27b-4c6f-8007-e5e329fe2dc0 tempest-AbsoluteLimitsTests-38428319 None] Lock "cinder-21258145-5241-42c1-be70-e4de860a0e69-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f638a8d7-a32e-4b6b-9824-53d8b14910d3 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f638a8d7-a32e-4b6b-9824-53d8b14910d3 tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-1254392278: creating Sep 25 21:25:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f638a8d7-a32e-4b6b-9824-53d8b14910d3 tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-1254392278: created successfully Sep 25 21:25:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f638a8d7-a32e-4b6b-9824-53d8b14910d3 tempest-GroupSnapshotsTest-1809104096 None] Create group completed successfully. Sep 25 21:25:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (fe840032-baae-4584-9f5c-ec2252dd3300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade9b1e8-f4ec-4688-a0a7-969489d03b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade9b1e8-f4ec-4688-a0a7-969489d03b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611029119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b97fcf7-61da-4f6c-8460-a47b1f61b014,host='devstack@QuobyteHD#QuobyteHD',id=ce6705f7-906a-4f6f-8422-20bdbdc73e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:24Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86acfce8-ba07-4739-909f-74e754cd92b8),volume_type_id=86acfce8-ba07-4739-909f-74e754cd92b8)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75be9890-fa21-409b-a8c7-0813e71329eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75be9890-fa21-409b-a8c7-0813e71329eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83361d2d-027c-4d75-b32d-07e379fb4197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83361d2d-027c-4d75-b32d-07e379fb4197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6705f7-906a-4f6f-8422-20bdbdc73e27', 'volume_name': 'volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a2d8ca-7aeb-406c-ae43-db8fc74ab020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a2d8ca-7aeb-406c-ae43-db8fc74ab020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd0a70-dc2c-4b5b-aba8-7ccc7a68ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:23 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Volume ce6705f7-906a-4f6f-8422-20bdbdc73e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27', 'volume_size': 1} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b97fcf7-61da-4f6c-8460-a47b1f61b014,created_at=2025-09-25T19:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611029119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b97fcf7-61da-4f6c-8460-a47b1f61b014,host='devstack@QuobyteHD#QuobyteHD',id=ce6705f7-906a-4f6f-8422-20bdbdc73e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:24Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86acfce8-ba07-4739-909f-74e754cd92b8),volume_type_id=86acfce8-ba07-4739-909f-74e754cd92b8)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Creating volume ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:23 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:24 devstack quobyte-client[84349]: System call of process 93148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:24 devstack quobyte-client[84349]: System call of process 93148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:24 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=33, name=volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 1073741824" returned: 0 in 0.450s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:24 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Flow 'volume_create_manager' (d8ab6f46-ce35-473c-a9b3-544318178400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75de7182-11e3-4e1f-a214-43361bb8d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75de7182-11e3-4e1f-a214-43361bb8d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-411728806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55248d09-c13d-4c0b-846f-93e1927bc6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1643a9aa709c42c1af8b56a8d265f28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:24Z,use_quota=True,user_id='f8964a5490a84262a3b709fba7cf3060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7076abff-8992-4e45-beed-851674f8bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7076abff-8992-4e45-beed-851674f8bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08668c6-6073-4127-8ec1-a8783a1d9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08668c6-6073-4127-8ec1-a8783a1d9be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55248d09-c13d-4c0b-846f-93e1927bc6c4', 'volume_name': 'volume-55248d09-c13d-4c0b-846f-93e1927bc6c4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb3f09-4720-4781-a0bd-65f35cf9e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb3f09-4720-4781-a0bd-65f35cf9e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8163df09-f583-4b79-b4ae-b82e8d1599eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:24 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Volume 55248d09-c13d-4c0b-846f-93e1927bc6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55248d09-c13d-4c0b-846f-93e1927bc6c4', 'volume_size': 1} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.548s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-411728806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55248d09-c13d-4c0b-846f-93e1927bc6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1643a9aa709c42c1af8b56a8d265f28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:24Z,use_quota=True,user_id='f8964a5490a84262a3b709fba7cf3060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Creating volume 55248d09-c13d-4c0b-846f-93e1927bc6c4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:25 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:25 devstack quobyte-client[84349]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:25 devstack quobyte-client[84349]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:25 devstack quobyte-client[84349]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:25 devstack quobyte-client[84349]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd0a70-dc2c-4b5b-aba8-7ccc7a68ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:25 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=34, name=volume-55248d09-c13d-4c0b-846f-93e1927bc6c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a4bd11-c2c8-4734-8394-7fdc5a2dedae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:25 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Volume volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 (ce6705f7-906a-4f6f-8422-20bdbdc73e27): created successfully Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a4bd11-c2c8-4734-8394-7fdc5a2dedae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (fe840032-baae-4584-9f5c-ec2252dd3300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-240c5d46-0457-4d92-b661-d1686d083912 tempest-GroupSnapshotsTest-1809104096 None] Created volume successfully. Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 1073741824" returned: 0 in 0.445s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4" returned: 0 in 0.092s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8163df09-f583-4b79-b4ae-b82e8d1599eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55248d09-c13d-4c0b-846f-93e1927bc6c4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0b588-746c-43b8-898c-1efe422ac649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:25 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Volume volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 (55248d09-c13d-4c0b-846f-93e1927bc6c4): created successfully Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0b588-746c-43b8-898c-1efe422ac649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Flow 'volume_create_manager' (d8ab6f46-ce35-473c-a9b3-544318178400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8bdfc363-0035-41a5-b7fe-1b3aa1f8af11 tempest-VolumesMetadataTest-475212297 None] Created volume successfully. Sep 25 21:25:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] GroupSnapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: creating. Sep 25 21:25:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Group snapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: creating. {{(pid=84334) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Creating offline snapshot 0283cd82-ca93-4888-b843-69bd423b1ee6 of volume ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae4bcd4-fd14-4a93-bbf8-171652784db2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Acquiring lock "cinder-55248d09-c13d-4c0b-846f-93e1927bc6c4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.756s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "cinder-55248d09-c13d-4c0b-846f-93e1927bc6c4-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:27 devstack quobyte-client[84349]: System call of process 93160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:27 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=35, name=volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 1G" returned: 0 in 0.406s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:28 devstack quobyte-client[84349]: System call of process 93163 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Acquiring lock "cinder-quobyte-55248d09-c13d-4c0b-846f-93e1927bc6c4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img rebase -u -b volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "cinder-quobyte-55248d09-c13d-4c0b-846f-93e1927bc6c4" acquired by "delete_volume" :: waited 0.241s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e5c9d-7294-433a-bae6-da48faabac4a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.340s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.137s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.info" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:29 devstack quobyte-client[84349]: System call of process 93168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.info" returned: 0 in 0.184s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4" returned: 0 in 0.670s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55248d09-c13d-4c0b-846f-93e1927bc6c4" returned: 0 in 0.263s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "cinder-quobyte-55248d09-c13d-4c0b-846f-93e1927bc6c4" released by "delete_volume" :: held 1.532s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-db42209e-684a-409b-a88d-f9d5360f172a tempest-GroupSnapshotsTest-1809104096 None] group_snapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: created successfully Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Created reservations ['8abf1684-65ff-4b4f-8425-7bc68c2a7854', 'dd9a4a70-b11b-4a3b-b3e4-97048536738b', '736ef42f-464c-4a65-9e38-aef3b651a185', '460d0112-c222-4820-9603-99f1a8bfd82e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Deleted volume successfully. Sep 25 21:25:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f2790125-5ae6-469d-a5d9-fb62a4637e0a tempest-VolumesMetadataTest-475212297 None] Lock "cinder-55248d09-c13d-4c0b-846f-93e1927bc6c4-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:32 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6-c52aa489-0916-4eaf-9582-8204195ba85d" by "_create_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6-c52aa489-0916-4eaf-9582-8204195ba85d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Creating volume c52aa489-0916-4eaf-9582-8204195ba85d from snapshot 0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" by "_copy_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] snapshot: 0283cd82-ca93-4888-b843-69bd423b1ee6, volume: c52aa489-0916-4eaf-9582-8204195ba85d, {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee531c5e-4faf-4445-b49a-bbd22f5d6204]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:33 devstack quobyte-client[84349]: System call of process 93190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.551s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Creating direct copy from snapshot {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b3459-f852-4dc9-b840-f5e125b07a96]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:33 devstack quobyte-client[84349]: System call of process 93195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:33 devstack quobyte-client[84349]: System call of process 93195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:33 devstack quobyte-client[84349]: System call of process 93195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.596s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG cinder.utils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d not found in is_blk_device check {{(pid=84334) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 25 21:25:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:34 devstack quobyte-client[84349]: System call of process 93199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:34 devstack quobyte-client[84349]: System call of process 93199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:34 devstack quobyte-client[84349]: System call of process 93199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:34 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=37, name=volume-c52aa489-0916-4eaf-9582-8204195ba85d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.162s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d" returned: 0 in 6.986s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.367s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab7312-07ee-473a-9962-90e95a0420ab]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.988s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:25:42 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Converted 1024.00 MB image at 144.60 MB/s Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Flow 'volume_create_manager' (42bd1079-7ed3-44f4-be7e-030d44d2334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d85f436-71e0-4e95-9dc0-27f7873d305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d" returned: 0 in 0.426s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d85f436-71e0-4e95-9dc0-27f7873d305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-362587000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87fee83-8b48-4448-952c-e00f5c86a989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc296acc2ee949c2b0381b289ef8de75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:42Z,use_quota=True,user_id='9543dfaab6ae4b0c8b74a3ef70e04d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df0b63a-6339-4b8e-94db-df3ff79ceb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df0b63a-6339-4b8e-94db-df3ff79ceb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643cee36-882c-4d21-a218-c8d2e3fe7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643cee36-882c-4d21-a218-c8d2e3fe7583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87fee83-8b48-4448-952c-e00f5c86a989', 'volume_name': 'volume-a87fee83-8b48-4448-952c-e00f5c86a989', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13433fd2-0e9a-483a-a745-55aa8c86e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13433fd2-0e9a-483a-a745-55aa8c86e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c1fb24-8125-435b-902f-b3d3f169ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:42 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Volume a87fee83-8b48-4448-952c-e00f5c86a989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87fee83-8b48-4448-952c-e00f5c86a989', 'volume_size': 1} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" released by "_copy_volume_from_snapshot" :: held 10.106s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6-c52aa489-0916-4eaf-9582-8204195ba85d" released by "_create_volume_from_snapshot" :: held 10.140s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.181s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-362587000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87fee83-8b48-4448-952c-e00f5c86a989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc296acc2ee949c2b0381b289ef8de75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:42Z,use_quota=True,user_id='9543dfaab6ae4b0c8b74a3ef70e04d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Creating volume a87fee83-8b48-4448-952c-e00f5c86a989 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:42 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:42 devstack quobyte-client[84349]: System call of process 93236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:42 devstack quobyte-client[84349]: System call of process 93236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:42 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=38, name=volume-a87fee83-8b48-4448-952c-e00f5c86a989, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989 1073741824" returned: 0 in 0.649s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989" returned: 0 in 0.892s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] <== create_volume: return (1596ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:44 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9789e1b0-026e-4452-9b8d-8b4cb8168c1f tempest-GroupSnapshotsTest-1809104096 None] Create group from source-snapshot-1a2495c6-b227-48bd-90a8-eb350a7d7f2d completed successfully. Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c1fb24-8125-435b-902f-b3d3f169ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87fee83-8b48-4448-952c-e00f5c86a989', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf036759-48a4-4aa7-8e68-173a39f8637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" acquired by "delete_volume" :: waited 0.075s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Volume volume-a87fee83-8b48-4448-952c-e00f5c86a989 (a87fee83-8b48-4448-952c-e00f5c86a989): created successfully Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf036759-48a4-4aa7-8e68-173a39f8637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Flow 'volume_create_manager' (42bd1079-7ed3-44f4-be7e-030d44d2334b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d5a71-7b64-490f-b7b4-88bf32cd217b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-833ee24d-fed1-4625-8dec-f114f28f478d tempest-VolumesTransfersV357Test-1971521688 None] Created volume successfully. Sep 25 21:25:44 devstack quobyte-client[84349]: System call of process 93245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d" returned: 0 in 0.539s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c52aa489-0916-4eaf-9582-8204195ba85d" returned: 0 in 0.125s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-c52aa489-0916-4eaf-9582-8204195ba85d" released by "delete_volume" :: held 0.842s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:45 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['5578bfae-a28f-447a-b8fc-2e91d57d75f3'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:46 devstack cinder-volume[84334]: WARNING cinder.quota [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1863184004 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1863184004, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:25:46 devstack cinder-volume[84334]: WARNING cinder.quota [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1863184004 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1863184004, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:25:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fc19ff62-315b-43b3-8855-e14f2ca5bf41 tempest-VolumesTransfersV357Test-792421932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['344a0cc2-3364-4343-8550-0266ed3fdadc', '2b378a99-02f7-4fc6-9b0b-56a34b30102e', 'c57711dd-033a-4838-85d8-406ac37ba3ed', 'd7bd8748-83bf-47a0-8604-f12ddcc43d9d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (58c2c42c-889a-4c35-b2fb-c3edf603c8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97a8ef-c2d3-4d55-b2d7-e4cdce875734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97a8ef-c2d3-4d55-b2d7-e4cdce875734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263462203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:46Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f253d365-ee26-438d-97a7-b9c3b785edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f253d365-ee26-438d-97a7-b9c3b785edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40933261-4d34-4ae8-9673-1867e4ca9236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40933261-4d34-4ae8-9673-1867e4ca9236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5', 'volume_name': 'volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c61f49f-0ebe-46f2-890c-f949a2389dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c61f49f-0ebe-46f2-890c-f949a2389dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec53ada-ad63-4744-8766-410e23ebe9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Volume 87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5', 'volume_size': 1} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263462203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:46Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Creating volume 87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:46 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fc19ff62-315b-43b3-8855-e14f2ca5bf41 tempest-VolumesTransfersV357Test-792421932 None] Transfer volume completed successfully. Sep 25 21:25:46 devstack quobyte-client[84349]: System call of process 93250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:46 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=39, name=volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 1073741824" returned: 0 in 0.568s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" returned: 0 in 0.532s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] <== create_volume: return (1151ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "cinder-a87fee83-8b48-4448-952c-e00f5c86a989-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec53ada-ad63-4744-8766-410e23ebe9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f23cbfc-4c95-479b-95a0-02adf92d3de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:48 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Volume volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 (87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5): created successfully Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f23cbfc-4c95-479b-95a0-02adf92d3de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (58c2c42c-889a-4c35-b2fb-c3edf603c8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-a87fee83-8b48-4448-952c-e00f5c86a989-delete_volume" acquired by "delete_volume" :: waited 0.572s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-99c46c4a-e88d-4e9f-beb9-1a6d30cbde67 tempest-AttachVolumeTestJSON-860812365 None] Created volume successfully. Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.475s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-68ebb727-69e9-4c39-b653-02efeccd852b tempest-GroupSnapshotsTest-1809104096 None] Delete group completed successfully. Sep 25 21:25:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "cinder-quobyte-a87fee83-8b48-4448-952c-e00f5c86a989" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] group_snapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: deleting Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-quobyte-a87fee83-8b48-4448-952c-e00f5c86a989" acquired by "delete_volume" :: waited 0.131s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6cd08-51f6-4501-aab2-2d83e53af009]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] group_snapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: deleting {{(pid=84334) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:49 devstack quobyte-client[84349]: System call of process 93255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:49 devstack quobyte-client[84349]: System call of process 93255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" acquired by "delete_snapshot" :: waited 0.109s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Deleting offline snapshot 0283cd82-ca93-4888-b843-69bd423b1ee6 of volume ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] snapshot_file for this snap is: volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989" returned: 0 in 0.814s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[11587c41-2047-43de-8cf8-f1cc99693576]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a87fee83-8b48-4448-952c-e00f5c86a989" returned: 0 in 0.194s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-quobyte-a87fee83-8b48-4448-952c-e00f5c86a989" released by "delete_volume" :: held 1.334s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Created reservations ['8c1634e8-1ea3-49c4-b89c-8f41ae6a398a', '416d9776-ba78-4557-bbd4-32ba0a1669f1', 'bd4bcd0a-1d43-470b-8682-dca42921a360', 'ae757384-eae2-4291-abb9-5d21dc91b3ce'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:50 devstack quobyte-client[84349]: System call of process 93259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.763s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00dc5f-8588-402a-a322-ee19f9a85deb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.136s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:50 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:51 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Deleted volume successfully. Sep 25 21:25:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8306b26e-8fb7-4eab-9041-493fc474dd76 tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-a87fee83-8b48-4448-952c-e00f5c86a989-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:51 devstack quobyte-client[84349]: System call of process 93262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:51 devstack quobyte-client[84349]: System call of process 93262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:51 devstack quobyte-client[84349]: System call of process 93262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.913s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:51 devstack quobyte-client[84349]: System call of process 93266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:51 devstack quobyte-client[84349]: System call of process 93266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.245s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27.0283cd82-ca93-4888-b843-69bd423b1ee6" returned: 0 in 0.171s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-0283cd82-ca93-4888-b843-69bd423b1ee6" released by "_delete_snapshot" :: held 2.871s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" released by "delete_snapshot" :: held 2.952s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Flow 'volume_create_manager' (5730bd71-30e0-495f-b6a5-f211f7eba7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c74c75-ae00-4f5a-bfc8-26db870cf0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c74c75-ae00-4f5a-bfc8-26db870cf0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1858534628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5351c6-7a54-4abe-866f-8632ee757240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc296acc2ee949c2b0381b289ef8de75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:52Z,use_quota=True,user_id='9543dfaab6ae4b0c8b74a3ef70e04d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79498c5d-7c91-49c8-9964-9a2e9433b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79498c5d-7c91-49c8-9964-9a2e9433b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398d01d4-5a04-40f9-a0de-1331f292a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398d01d4-5a04-40f9-a0de-1331f292a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5351c6-7a54-4abe-866f-8632ee757240', 'volume_name': 'volume-4a5351c6-7a54-4abe-866f-8632ee757240', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9365b379-e982-438b-8936-c8463ea3bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9365b379-e982-438b-8936-c8463ea3bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d763975b-abbe-4b65-9072-1d9a79a775a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Volume 4a5351c6-7a54-4abe-866f-8632ee757240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5351c6-7a54-4abe-866f-8632ee757240', 'volume_size': 1} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1858534628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5351c6-7a54-4abe-866f-8632ee757240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc296acc2ee949c2b0381b289ef8de75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:25:52Z,use_quota=True,user_id='9543dfaab6ae4b0c8b74a3ef70e04d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Creating volume 4a5351c6-7a54-4abe-866f-8632ee757240 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:25:52 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:25:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:52 devstack quobyte-client[84349]: System call of process 93279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:25:53 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=40, name=volume-4a5351c6-7a54-4abe-866f-8632ee757240, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:53 devstack cinder-volume[84334]: WARNING cinder.quota [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1863184004 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1863184004, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240 1073741824" returned: 0 in 0.590s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['ed4db751-0b72-4a10-922c-21ed1804c7b6', '73ed2c32-e62a-4858-ba3f-1240657b0ca8', '96165153-b5b7-4b67-af11-503e2c88d7a8', 'bbeb11ec-3ada-4173-b35b-add23f9902cc'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240" returned: 0 in 0.287s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] <== create_volume: return (906ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.395s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34c436-5690-4410-a09d-5f9badfa505d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d763975b-abbe-4b65-9072-1d9a79a775a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5351c6-7a54-4abe-866f-8632ee757240', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b37e13-ad55-4ee5-90dc-19e161163849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:25:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Volume volume-4a5351c6-7a54-4abe-866f-8632ee757240 (4a5351c6-7a54-4abe-866f-8632ee757240): created successfully Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b37e13-ad55-4ee5-90dc-19e161163849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Flow 'volume_create_manager' (5730bd71-30e0-495f-b6a5-f211f7eba7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:25:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b8052703-9a05-40f7-ba91-df09c9b6b8bc tempest-GroupSnapshotsTest-1809104096 None] group_snapshot 1a2495c6-b227-48bd-90a8-eb350a7d7f2d: deleted successfully Sep 25 21:25:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d08a8381-31cf-4c62-b4ec-41569cb5f270 tempest-VolumesTransfersV357Test-1971521688 None] Created volume successfully. Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" returned: 0 in 0.565s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.682s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cac67648-cf91-4991-b6e0-cc2abce4d8b4', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:25:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-bd4cc23d-42e7-4e26-81d4-9cfbd051dcbd req-f1fa6217-82fd-454a-81ca-2744e2bb6f9c tempest-AttachVolumeTestJSON-860812365 None] attachment_update completed successfully. Sep 25 21:25:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" acquired by "delete_volume" :: waited 0.047s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa767c-769a-4c0e-8ee4-82107e9cccb4]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.483s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ce6705f7-906a-4f6f-8422-20bdbdc73e27" returned: 0 in 0.277s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-ce6705f7-906a-4f6f-8422-20bdbdc73e27" released by "delete_volume" :: held 1.037s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "cinder-4a5351c6-7a54-4abe-866f-8632ee757240-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-4a5351c6-7a54-4abe-866f-8632ee757240-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "cinder-quobyte-4a5351c6-7a54-4abe-866f-8632ee757240" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-quobyte-4a5351c6-7a54-4abe-866f-8632ee757240" acquired by "delete_volume" :: waited 0.022s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['57e59827-1065-4302-b024-8d596ebd6874'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e3424b-85e2-4879-9dd1-8b1f4dea1a94]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:56 devstack cinder-volume[84334]: WARNING cinder.db.sqlalchemy.api [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1863184004'] Sep 25 21:25:56 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['021a1338-9dd5-48c2-b48e-140278e0c295', '7a7005dd-63f3-4b46-9dda-6c67c9acfcf6', '7216d6d9-1218-45ae-84b9-645397ea9b01', 'e1b199b0-5151-4631-9431-a6e5e9508d50'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240" returned: 0 in 0.681s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4a5351c6-7a54-4abe-866f-8632ee757240" returned: 0 in 0.304s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-quobyte-4a5351c6-7a54-4abe-866f-8632ee757240" released by "delete_volume" :: held 1.231s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Created reservations ['34ce0583-46b7-4ace-a467-94a1da3bff56', '2d61883d-31c2-4f1b-923d-d664fe3026f8', 'f758143d-4ca4-4d85-b20c-817f22f6496a', '0d4c0a80-8e41-4d0e-90ca-388affc73730'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.379s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-baf18c3d-d526-420a-8c5b-29b3761e2247 tempest-GroupSnapshotsTest-1809104096 None] Delete group completed successfully. Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.077s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.328s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:25:58 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:25:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Deleted volume successfully. Sep 25 21:25:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da0d0662-4be5-4410-9596-ffa7d63be4fa tempest-VolumesTransfersV357Test-1533787930 None] Lock "cinder-4a5351c6-7a54-4abe-866f-8632ee757240-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:25:59 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:25:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-97efd0bf-9e2b-47be-8d8f-cd8487e5951e tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:25:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-97efd0bf-9e2b-47be-8d8f-cd8487e5951e tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-1695220386: creating Sep 25 21:25:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-97efd0bf-9e2b-47be-8d8f-cd8487e5951e tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-1695220386: created successfully Sep 25 21:25:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-97efd0bf-9e2b-47be-8d8f-cd8487e5951e tempest-GroupSnapshotsTest-1809104096 None] Create group completed successfully. Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=95,cinder:SELECT=85,cinder:DELETE=6,cinder:INSERT=21 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:26:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (e7ed134b-2e88-4332-befe-917251668368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248ad78a-daa1-4c14-936e-8ae76f41b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248ad78a-daa1-4c14-936e-8ae76f41b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155598767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,host='devstack@QuobyteHD#QuobyteHD',id=681a4e91-88d0-4150-b5a1-7cc058f08b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:01Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(802b345f-6e05-44af-96ea-d9494ea7644b),volume_type_id=802b345f-6e05-44af-96ea-d9494ea7644b)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52964c56-8af5-4815-9405-cb2f920782b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52964c56-8af5-4815-9405-cb2f920782b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935daba9-c0ae-4b3b-973c-db54fa251b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935daba9-c0ae-4b3b-973c-db54fa251b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681a4e91-88d0-4150-b5a1-7cc058f08b05', 'volume_name': 'volume-681a4e91-88d0-4150-b5a1-7cc058f08b05', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30acb5d5-d96a-4037-afb4-8d89ded9a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30acb5d5-d96a-4037-afb4-8d89ded9a466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6925d38-1a7a-4daa-b9d0-16de25bcc8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Volume 681a4e91-88d0-4150-b5a1-7cc058f08b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681a4e91-88d0-4150-b5a1-7cc058f08b05', 'volume_size': 1} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,created_at=2025-09-25T19:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155598767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,host='devstack@QuobyteHD#QuobyteHD',id=681a4e91-88d0-4150-b5a1-7cc058f08b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:01Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(802b345f-6e05-44af-96ea-d9494ea7644b),volume_type_id=802b345f-6e05-44af-96ea-d9494ea7644b)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Creating volume 681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:26:01 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:26:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:01 devstack quobyte-client[84349]: System call of process 93714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:01 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=41, name=volume-681a4e91-88d0-4150-b5a1-7cc058f08b05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 1073741824" returned: 0 in 0.759s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05" returned: 0 in 0.178s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] <== create_volume: return (1123ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6925d38-1a7a-4daa-b9d0-16de25bcc8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681a4e91-88d0-4150-b5a1-7cc058f08b05', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40c8eaa-b046-496b-a8e4-6692fad09c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Volume volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 (681a4e91-88d0-4150-b5a1-7cc058f08b05): created successfully Sep 25 21:26:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40c8eaa-b046-496b-a8e4-6692fad09c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (e7ed134b-2e88-4332-befe-917251668368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d54ad810-d78f-453b-9368-91c132ec105c tempest-GroupSnapshotsTest-1809104096 None] Created volume successfully. Sep 25 21:26:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:04 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (3c1a368b-4069-4afa-b998-48fd8527f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1e22ac-88e1-41df-931a-42214edcb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1e22ac-88e1-41df-931a-42214edcb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796583646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,host='devstack@QuobyteHD#QuobyteHD',id=e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:05Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(802b345f-6e05-44af-96ea-d9494ea7644b),volume_type_id=802b345f-6e05-44af-96ea-d9494ea7644b)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fbfc55-c127-4f4b-b5d0-3c0a7405b6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fbfc55-c127-4f4b-b5d0-3c0a7405b6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b31cd1b-7e2d-42ee-956d-9b1e09388ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b31cd1b-7e2d-42ee-956d-9b1e09388ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9', 'volume_name': 'volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cd9c83-3058-4574-bdba-49496df3a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cd9c83-3058-4574-bdba-49496df3a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f5ff09-3ba8-4b90-a404-9be9a134c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Volume e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9', 'volume_size': 1} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,created_at=2025-09-25T19:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796583646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5daf2c-ce1b-432f-824e-dd76733a40a1,host='devstack@QuobyteHD#QuobyteHD',id=e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:05Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(802b345f-6e05-44af-96ea-d9494ea7644b),volume_type_id=802b345f-6e05-44af-96ea-d9494ea7644b)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Creating volume e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:26:05 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:05 devstack quobyte-client[84349]: System call of process 93758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:05 devstack quobyte-client[84349]: System call of process 93758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:05 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=42, name=volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 1073741824" returned: 0 in 0.484s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" returned: 0 in 0.181s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:26:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f5ff09-3ba8-4b90-a404-9be9a134c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59141a29-dc77-4f14-baf7-3c4310418c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Volume volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 (e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9): created successfully Sep 25 21:26:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59141a29-dc77-4f14-baf7-3c4310418c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (3c1a368b-4069-4afa-b998-48fd8527f106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e890934a-8ce0-41f6-9487-cd6e3af8a8b7 tempest-GroupSnapshotsTest-1809104096 None] Created volume successfully. Sep 25 21:26:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-aa0c6c9e-109f-4a39-aad6-b50de2d21572 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:07 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-aa0c6c9e-109f-4a39-aad6-b50de2d21572 tempest-GroupSnapshotsTest-1809104096 None] Update group completed successfully. Sep 25 21:26:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a22d0be5-5b87-4145-9aef-dcaac3bb69b9 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a22d0be5-5b87-4145-9aef-dcaac3bb69b9 tempest-GroupSnapshotsTest-1809104096 None] Update group completed successfully. Sep 25 21:26:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-afb851c5-645a-4078-8b7a-aab7fa46d286 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:09 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-afb851c5-645a-4078-8b7a-aab7fa46d286 tempest-GroupSnapshotsTest-1809104096 None] Update group completed successfully. Sep 25 21:26:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Flow 'volume_create_manager' (a46844f8-abe8-4122-b9b4-ecdb18870ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876eed7d-dcd2-4fd8-8d65-559b50701afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876eed7d-dcd2-4fd8-8d65-559b50701afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-204469272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a711c-221a-4f90-a473-d61962f4a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62b70b579c54d4cb2c427233cfa77e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:10Z,use_quota=True,user_id='06e346aca48f4d3c95de424581e5e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981f4540-eabb-4dad-81e3-acb08f7f07e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981f4540-eabb-4dad-81e3-acb08f7f07e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036530ed-64ab-4ecc-80c5-f129fd033fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036530ed-64ab-4ecc-80c5-f129fd033fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0a711c-221a-4f90-a473-d61962f4a1c6', 'volume_name': 'volume-fa0a711c-221a-4f90-a473-d61962f4a1c6', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3406cac9-9ec9-4b85-9acc-39d8cb22d6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3406cac9-9ec9-4b85-9acc-39d8cb22d6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c14419-7684-4b19-b191-0619c9a04630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:09 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Volume fa0a711c-221a-4f90-a473-d61962f4a1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0a711c-221a-4f90-a473-d61962f4a1c6', 'volume_size': 1} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-204469272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a711c-221a-4f90-a473-d61962f4a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62b70b579c54d4cb2c427233cfa77e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:10Z,use_quota=True,user_id='06e346aca48f4d3c95de424581e5e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Creating volume fa0a711c-221a-4f90-a473-d61962f4a1c6 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:26:10 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=43, name=volume-fa0a711c-221a-4f90-a473-d61962f4a1c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 1073741824" returned: 0 in 0.348s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6" returned: 0 in 0.091s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c14419-7684-4b19-b191-0619c9a04630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0a711c-221a-4f90-a473-d61962f4a1c6', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c53897-2819-4b66-9ec5-d8d79febf8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:10 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Volume volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 (fa0a711c-221a-4f90-a473-d61962f4a1c6): created successfully Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c53897-2819-4b66-9ec5-d8d79febf8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Flow 'volume_create_manager' (a46844f8-abe8-4122-b9b4-ecdb18870ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:10 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-20d57b7b-ff9b-4598-8dad-3c96246e4d27 tempest-VolumesNegativeTest-428006909 None] Created volume successfully. Sep 25 21:26:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-6c73d9a3-3441-4459-953b-9696184f5990 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-6c73d9a3-3441-4459-953b-9696184f5990 tempest-GroupSnapshotsTest-1809104096 None] Update group completed successfully. Sep 25 21:26:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] GroupSnapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: creating. Sep 25 21:26:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Group snapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: creating. {{(pid=84334) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Creating offline snapshot 36a41920-f83e-42d2-89a0-8b100e3bbdf6 of volume 681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3a7ef5-ebe1-4bca-bc0f-8e38867fa7ce]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:14 devstack quobyte-client[84349]: System call of process 93807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05" returned: 0 in 1.016s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:14 devstack quobyte-client[84349]: System call of process 93839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:14 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=44, name=volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 1G" returned: 0 in 0.403s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img rebase -u -b volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img rebase -u -b volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.162s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.098s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.173s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.info" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.info" returned: 0 in 0.115s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Creating offline snapshot f15905b4-cbdc-4f46-ad9e-7528c2437113 of volume e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:26:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a3ba2-6cb4-4288-91a4-28da7ee88a7c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:16 devstack quobyte-client[84349]: System call of process 93888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" returned: 0 in 0.785s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:17 devstack quobyte-client[84349]: System call of process 93894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:17 devstack quobyte-client[84349]: System call of process 93894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:17 devstack quobyte-client[84349]: System call of process 93894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:17 devstack quobyte-client[84349]: System call of process 93894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:17 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=46, name=volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 1G" returned: 0 in 0.308s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img rebase -u -b volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 0.194s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.info" returned: 0 in 0.166s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.info" returned: 0 in 0.174s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dfbbfce3-4706-48ef-b7e9-23a852194961 tempest-GroupSnapshotsTest-1809104096 None] group_snapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: created successfully Sep 25 21:26:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] group_snapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: deleting Sep 25 21:26:19 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] group_snapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: deleting {{(pid=84334) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 25 21:26:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" acquired by "delete_snapshot" :: waited 0.075s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-36a41920-f83e-42d2-89a0-8b100e3bbdf6" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-36a41920-f83e-42d2-89a0-8b100e3bbdf6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Deleting offline snapshot 36a41920-f83e-42d2-89a0-8b100e3bbdf6 of volume 681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] snapshot_file for this snap is: volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[70921b52-e42c-410a-ab69-ca3e2a06eaf6]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:20 devstack quobyte-client[84349]: System call of process 93915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.507s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681a4e91-88d0-4150-b5a1-7cc058f08b05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e14e6-2725-44f2-9ae8-c3841cbb6360]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:21 devstack quobyte-client[84349]: System call of process 94234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05" returned: 0 in 0.645s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:21 devstack quobyte-client[84349]: System call of process 94240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:21 devstack quobyte-client[84349]: System call of process 94240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.392s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05.36a41920-f83e-42d2-89a0-8b100e3bbdf6" returned: 0 in 0.153s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-36a41920-f83e-42d2-89a0-8b100e3bbdf6" released by "_delete_snapshot" :: held 2.418s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" released by "delete_snapshot" :: held 2.482s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-f15905b4-cbdc-4f46-ad9e-7528c2437113" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-f15905b4-cbdc-4f46-ad9e-7528c2437113" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Deleting offline snapshot f15905b4-cbdc-4f46-ad9e-7528c2437113 of volume e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] snapshot_file for this snap is: volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95f8c4-20c3-4b01-bb95-dea63686596d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:24 devstack quobyte-client[84349]: System call of process 94253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 1.611s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:26:24 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf288c-c531-46cf-91a4-9308fa202288]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:26 devstack quobyte-client[84349]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:26 devstack quobyte-client[84349]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" returned: 0 in 2.054s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:27 devstack quobyte-client[84349]: System call of process 94318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:27 devstack quobyte-client[84349]: System call of process 94318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:27 devstack quobyte-client[84349]: System call of process 94318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:27 devstack quobyte-client[84349]: System call of process 94318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 0.725s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9.f15905b4-cbdc-4f46-ad9e-7528c2437113" returned: 0 in 0.300s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-f15905b4-cbdc-4f46-ad9e-7528c2437113" released by "_delete_snapshot" :: held 5.823s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" released by "delete_snapshot" :: held 5.858s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:29 devstack cinder-volume[84334]: WARNING cinder.quota [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-66689311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-66689311, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:29 devstack cinder-volume[84334]: WARNING cinder.quota [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-66689311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-66689311, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:29 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['b4928c2a-ed2f-4146-bcb2-c91980de5984', '03c502a6-4ce0-4b3f-bd0f-44c09391043f', '16d70a3c-9d25-49dd-98cc-bdb561c22836', '99bc39fc-402e-44ee-b8ad-0a3c3c89c68e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:30 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['fb39b39b-cbf9-4314-9c01-d8ca716be62e', 'd809c945-b370-46ac-ac74-5feef3d425c1', 'b6a695c4-5953-4b7d-b306-3225b0bc979f', '67904ef2-0da2-4bd8-ad00-ba5177fecc5d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cc836278-b725-4f07-b401-e18d24f2251e tempest-GroupSnapshotsTest-1809104096 None] group_snapshot b105884c-7fcb-4fa3-8f9c-3617ab5917db: deleted successfully Sep 25 21:26:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" acquired by "delete_volume" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:31 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d479a59-4590-4782-bfc4-e364d2309b88]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:32 devstack quobyte-client[84349]: System call of process 94345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05" returned: 0 in 0.438s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-681a4e91-88d0-4150-b5a1-7cc058f08b05" returned: 0 in 0.155s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-681a4e91-88d0-4150-b5a1-7cc058f08b05" released by "delete_volume" :: held 0.822s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" acquired by "delete_volume" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb89774-a767-4a04-9634-6cc581274e9b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" returned: 0 in 0.697s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" returned: 0 in 0.133s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-e3ea4e3a-070f-4f9f-9aad-fabaa53b85f9" released by "delete_volume" :: held 1.045s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['9f3bdfb7-c503-4ffc-be72-b3983703b44a'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:34 devstack cinder-volume[84334]: WARNING cinder.quota [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-66689311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-66689311, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['b2e5fa44-5600-405c-9513-6e1360d944b1', '91f410a8-f14a-4e77-8fa4-ebc81e50c52f', 'ae6cfc43-2f74-4db2-b082-c8124d95e39d', '66e316e5-302d-41b5-a6bd-e57ddd01846b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['6f1c5d60-a915-45ed-bc8a-2df08b0c0f51', '1e2da222-34ca-49cd-8026-8c861a8f91c8', '6aab3fc9-59d7-41a6-9513-54e19e6cb80c', '2efcab37-39c5-4994-a8dd-a2bd5c3f1eb2'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:34 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:26:34 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5d09f84d-63c7-4290-b1d5-912b37c620e5 tempest-GroupSnapshotsTest-1809104096 None] Delete group completed successfully. Sep 25 21:26:35 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bc4111ee-a3cf-439b-b0b0-7f7fc744f415 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bc4111ee-a3cf-439b-b0b0-7f7fc744f415 tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-657010768: creating Sep 25 21:26:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bc4111ee-a3cf-439b-b0b0-7f7fc744f415 tempest-GroupSnapshotsTest-1809104096 None] Group tempest-GroupSnapshotsTest-Group-657010768: created successfully Sep 25 21:26:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bc4111ee-a3cf-439b-b0b0-7f7fc744f415 tempest-GroupSnapshotsTest-1809104096 None] Create group completed successfully. Sep 25 21:26:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (a5079f2c-10fe-42d4-aa3d-8af8dd65ed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2a0b66-4e5b-45e5-a076-7e7de078042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2a0b66-4e5b-45e5-a076-7e7de078042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1792314324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=252fda82-993c-4d44-a09b-b094a163943c,host='devstack@QuobyteHD#QuobyteHD',id=1a66f0c6-0bf8-43e5-bc39-deaa920a9a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:37Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c5fb5db-d024-4370-9a92-826e1e8c1cd1),volume_type_id=8c5fb5db-d024-4370-9a92-826e1e8c1cd1)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d696fd1b-ccb7-4d78-bb65-d29498f3bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d696fd1b-ccb7-4d78-bb65-d29498f3bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09ff95c-0bbf-404d-a6df-c09f683b5312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09ff95c-0bbf-404d-a6df-c09f683b5312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a66f0c6-0bf8-43e5-bc39-deaa920a9a70', 'volume_name': 'volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346807ab-8e6b-4ddd-9c94-bb7f7e46ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346807ab-8e6b-4ddd-9c94-bb7f7e46ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85730b-c7fb-409f-9c5a-e028911e9b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:37 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Volume 1a66f0c6-0bf8-43e5-bc39-deaa920a9a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70', 'volume_size': 1} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=252fda82-993c-4d44-a09b-b094a163943c,created_at=2025-09-25T19:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1792314324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=252fda82-993c-4d44-a09b-b094a163943c,host='devstack@QuobyteHD#QuobyteHD',id=1a66f0c6-0bf8-43e5-bc39-deaa920a9a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9ba5c6a0f43b09bd0763a2f5fd0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:26:37Z,use_quota=True,user_id='e62456742c084529a11c5007f3a3aea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c5fb5db-d024-4370-9a92-826e1e8c1cd1),volume_type_id=8c5fb5db-d024-4370-9a92-826e1e8c1cd1)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Creating volume 1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:26:37 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:26:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:37 devstack quobyte-client[84349]: System call of process 94396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:37 devstack quobyte-client[84349]: System call of process 94396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:37 devstack quobyte-client[84349]: System call of process 94396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:37 devstack quobyte-client[84349]: System call of process 94396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:37 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=48, name=volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 1073741824" returned: 0 in 0.602s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" returned: 0 in 0.146s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:26:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85730b-c7fb-409f-9c5a-e028911e9b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abde8d3-1bfb-43ec-9fbf-418665f9a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:26:39 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Volume volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 (1a66f0c6-0bf8-43e5-bc39-deaa920a9a70): created successfully Sep 25 21:26:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abde8d3-1bfb-43ec-9fbf-418665f9a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:26:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Flow 'volume_create_manager' (a5079f2c-10fe-42d4-aa3d-8af8dd65ed48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:26:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0c36ca73-377f-478a-80d6-623cd0e93c49 tempest-GroupSnapshotsTest-1809104096 None] Created volume successfully. Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.279s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:26:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] GroupSnapshot e35be43d-4618-4fd0-82af-489f437c37bc: creating. Sep 25 21:26:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Group snapshot e35be43d-4618-4fd0-82af-489f437c37bc: creating. {{(pid=84334) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 25 21:26:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Creating offline snapshot 4f5e4742-0203-4f95-8b2a-94f046c8ef4f of volume 1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:26:42 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfcd574-c33c-4dfa-bd69-8588e17b35eb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:43 devstack quobyte-client[84349]: System call of process 94462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:43 devstack quobyte-client[84349]: System call of process 94462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" returned: 0 in 1.548s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:44 devstack quobyte-client[84349]: System call of process 94469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:44 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=49, name=volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:26:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f 1G" returned: 0 in 0.718s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:44 devstack quobyte-client[84349]: System call of process 94474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img rebase -u -b volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.304s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.180s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.261s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.info" returned: 0 in 0.166s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:26:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.info" returned: 0 in 0.120s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.182s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1eaa81b0-1d0b-47e2-b5c0-6fff8ad4c54e tempest-GroupSnapshotsTest-1809104096 None] group_snapshot e35be43d-4618-4fd0-82af-489f437c37bc: created successfully Sep 25 21:26:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] group_snapshot e35be43d-4618-4fd0-82af-489f437c37bc: deleting Sep 25 21:26:47 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] group_snapshot e35be43d-4618-4fd0-82af-489f437c37bc: deleting {{(pid=84334) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" acquired by "delete_snapshot" :: waited 0.101s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-4f5e4742-0203-4f95-8b2a-94f046c8ef4f" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-4f5e4742-0203-4f95-8b2a-94f046c8ef4f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Deleting offline snapshot 4f5e4742-0203-4f95-8b2a-94f046c8ef4f of volume 1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] snapshot_file for this snap is: volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5606fc6-64ae-497f-bba5-7fa79b9bd7fa]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:48 devstack quobyte-client[84349]: System call of process 94487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:48 devstack quobyte-client[84349]: System call of process 94487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:48 devstack quobyte-client[84349]: System call of process 94487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.959s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:26:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e0a51-204e-4bce-b97b-f4470a8771cc]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" returned: 0 in 0.882s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:50 devstack quobyte-client[84349]: System call of process 94493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.403s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70.4f5e4742-0203-4f95-8b2a-94f046c8ef4f" returned: 0 in 0.118s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-4f5e4742-0203-4f95-8b2a-94f046c8ef4f" released by "_delete_snapshot" :: held 3.316s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" released by "delete_snapshot" :: held 3.449s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:53 devstack cinder-volume[84334]: WARNING cinder.quota [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-777868475 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-777868475, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:53 devstack cinder-volume[84334]: WARNING cinder.quota [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-777868475 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-777868475, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:53 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['65000015-49b8-4dda-b9a3-3789c73b08eb', '846ccf25-1edc-43ea-9917-16710b893214', '5bc02eb9-8d6c-485c-8daf-69b91a15a0e3', '6135aa95-3a33-404a-91ae-bf6e4e5425d1'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:53 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b8501fa1-6156-4158-bd77-0b6d6988bd84 tempest-GroupSnapshotsTest-1809104096 None] group_snapshot e35be43d-4618-4fd0-82af-489f437c37bc: deleted successfully Sep 25 21:26:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:26:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:26:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" acquired by "delete_volume" :: waited 0.046s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:26:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3a6e3-d9a7-4ed3-9127-b8e455c484bc]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:26:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:55 devstack quobyte-client[84349]: System call of process 94550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:55 devstack quobyte-client[84349]: System call of process 94550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:26:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" returned: 0 in 0.876s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" returned: 0 in 0.186s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Lock "cinder-quobyte-1a66f0c6-0bf8-43e5-bc39-deaa920a9a70" released by "delete_volume" :: held 1.745s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['03c4c0f6-0e3e-4335-876b-d264bd122107'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:57 devstack cinder-volume[84334]: WARNING cinder.quota [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-777868475 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-777868475, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Created reservations ['d9d69a90-a848-4f04-ba97-9ffa1d8818ca', '59e94adc-d345-4dd5-bf69-511318ae2c12', '0d874fa7-c937-47db-8907-b64236feef8d', '625c0279-349e-461d-93fa-a587b7e768f3'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:26:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:26:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.215s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:26:58 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:26:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1d60be1c-db3a-4e2a-a874-f01f8d1c517c tempest-GroupSnapshotsTest-1809104096 None] Delete group completed successfully. Sep 25 21:27:05 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=69,cinder:UPDATE=63,cinder:DELETE=1,cinder:INSERT=11 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:27:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-51dbd9b1-1b70-4e10-9bc7-8f7f95cda732 tempest-GroupsV320Test-1531273999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-51dbd9b1-1b70-4e10-9bc7-8f7f95cda732 tempest-GroupsV320Test-1531273999 None] Group tempest-GroupsV320Test-Group-2030179829: creating Sep 25 21:27:05 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=66,cinder:DELETE=3,cinder:SELECT=66,cinder:INSERT=15 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:27:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-51dbd9b1-1b70-4e10-9bc7-8f7f95cda732 tempest-GroupsV320Test-1531273999 None] Group tempest-GroupsV320Test-Group-2030179829: created successfully Sep 25 21:27:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-51dbd9b1-1b70-4e10-9bc7-8f7f95cda732 tempest-GroupsV320Test-1531273999 None] Create group completed successfully. Sep 25 21:27:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Created reservations ['46d044ce-a39a-4339-831b-6d0c571f2bdd'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.180s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:07 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:27:07 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5668e9de-67be-4abf-ace8-2138f5e6590b tempest-GroupsV320Test-1531273999 None] Delete group completed successfully. Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Acquiring lock "cinder-fa0a711c-221a-4f90-a473-d61962f4a1c6-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "cinder-fa0a711c-221a-4f90-a473-d61962f4a1c6-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:27:10 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Acquiring lock "cinder-quobyte-fa0a711c-221a-4f90-a473-d61962f4a1c6" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "cinder-quobyte-fa0a711c-221a-4f90-a473-d61962f4a1c6" acquired by "delete_volume" :: waited 0.016s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[05534a23-5208-4440-9848-3a6a22d458f4]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:27:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6" returned: 0 in 0.411s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa0a711c-221a-4f90-a473-d61962f4a1c6" returned: 0 in 0.133s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "cinder-quobyte-fa0a711c-221a-4f90-a473-d61962f4a1c6" released by "delete_volume" :: held 0.745s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:27:11 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Created reservations ['1f626fea-daf1-4883-a66a-b243114dab57', '509ca649-efc1-4602-8216-b95a2b624f35', '5f92f6a8-a415-4ab7-a82c-f39814b56a50', '6444f1c8-0d45-45f1-a672-16ea91d79f49'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.096s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:27:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Deleted volume successfully. Sep 25 21:27:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ece29ec-58b2-4d7f-8ec2-6215d8cdc01c tempest-VolumesNegativeTest-428006909 None] Lock "cinder-fa0a711c-221a-4f90-a473-d61962f4a1c6-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:27:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:27:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.188s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:27:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (0e64df7d-e5bf-43ea-93d6-d2523cfc19e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903bbdcd-a2a9-4954-add0-eef752338b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903bbdcd-a2a9-4954-add0-eef752338b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1101072761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73981628-ff1f-4270-ade6-bd27029f9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:46Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0840418e-e191-4ccd-bc0c-9dd82a47c174),volume_type_id=0840418e-e191-4ccd-bc0c-9dd82a47c174)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84541ef2-3da5-41af-9acb-bb90db8534ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84541ef2-3da5-41af-9acb-bb90db8534ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af22333-5c84-47c8-adf4-ab3e84f50061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af22333-5c84-47c8-adf4-ab3e84f50061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73981628-ff1f-4270-ade6-bd27029f9f71', 'volume_name': 'volume-73981628-ff1f-4270-ade6-bd27029f9f71', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801cc3f-55c9-44f5-abf3-60324195c3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801cc3f-55c9-44f5-abf3-60324195c3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cd1b4f-ae12-452c-9305-61a11fc59b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume 73981628-ff1f-4270-ade6-bd27029f9f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73981628-ff1f-4270-ade6-bd27029f9f71', 'volume_size': 1} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1101072761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73981628-ff1f-4270-ade6-bd27029f9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:46Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0840418e-e191-4ccd-bc0c-9dd82a47c174),volume_type_id=0840418e-e191-4ccd-bc0c-9dd82a47c174)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Creating volume 73981628-ff1f-4270-ade6-bd27029f9f71 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:27:46 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:27:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:47 devstack quobyte-client[84349]: System call of process 94676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:47 devstack quobyte-client[84349]: System call of process 94676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:47 devstack quobyte-client[84349]: System call of process 94676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:47 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=51, name=volume-73981628-ff1f-4270-ade6-bd27029f9f71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:27:47 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:47 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:27:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (b2fd71ba-d5d7-4019-8f02-a70b8d542200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:27:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a747a9ea-8723-48fc-a734-c65b866bbbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 1073741824" returned: 0 in 0.758s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a747a9ea-8723-48fc-a734-c65b866bbbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812852124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb91075f-ec47-4afd-aa87-0c462cb2d9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:47Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5c79e5c-106c-4608-8878-1b992823fd9a),volume_type_id=d5c79e5c-106c-4608-8878-1b992823fd9a)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d5b2d-ea01-4f49-ba17-31e3cefb127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d5b2d-ea01-4f49-ba17-31e3cefb127f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54c27ef-1202-46b3-9499-7ffeec7a82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54c27ef-1202-46b3-9499-7ffeec7a82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb91075f-ec47-4afd-aa87-0c462cb2d9cb', 'volume_name': 'volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fea0ce-b0d8-4a92-99ba-a1e4c69c1c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fea0ce-b0d8-4a92-99ba-a1e4c69c1c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5559ae8c-7a5f-485b-b9bd-3053dd02f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume eb91075f-ec47-4afd-aa87-0c462cb2d9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb', 'volume_size': 1} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71" returned: 0 in 0.399s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.040s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812852124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb91075f-ec47-4afd-aa87-0c462cb2d9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:47Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5c79e5c-106c-4608-8878-1b992823fd9a),volume_type_id=d5c79e5c-106c-4608-8878-1b992823fd9a)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Creating volume eb91075f-ec47-4afd-aa87-0c462cb2d9cb {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:27:48 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:48 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=52, name=volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:27:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (560d204a-9b23-469c-a431-16d30037f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4629e7-6b4a-4857-8692-03e6e27d64e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cd1b4f-ae12-452c-9305-61a11fc59b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73981628-ff1f-4270-ade6-bd27029f9f71', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd849859-7b91-4d1e-97d4-c6de03620ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb 1073741824" returned: 0 in 0.661s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4629e7-6b4a-4857-8692-03e6e27d64e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609587975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83a4ec-f9ee-4c87-852a-6cf773a24708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:48Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a39c0b2-77d0-4815-9e6e-391b3e23a934),volume_type_id=5a39c0b2-77d0-4815-9e6e-391b3e23a934)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03e11d-206b-4eff-a511-ae3da43f9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03e11d-206b-4eff-a511-ae3da43f9cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0016efbb-86de-400b-b577-8dc59df84b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:27:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:49 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume volume-73981628-ff1f-4270-ade6-bd27029f9f71 (73981628-ff1f-4270-ade6-bd27029f9f71): created successfully Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd849859-7b91-4d1e-97d4-c6de03620ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (0e64df7d-e5bf-43ea-93d6-d2523cfc19e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" returned: 0 in 0.509s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] <== create_volume: return (1351ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5417a5f5-d8b3-45c5-ba0c-374a8517792f tempest-TestInstancesWithCinderVolumes-1677631332 None] Created volume successfully. Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5559ae8c-7a5f-485b-b9bd-3053dd02f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd1ccd-770c-4771-8b67-21bca47895f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:49 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb (eb91075f-ec47-4afd-aa87-0c462cb2d9cb): created successfully Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd1ccd-770c-4771-8b67-21bca47895f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (b2fd71ba-d5d7-4019-8f02-a70b8d542200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:27:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8846cb08-2ebc-4783-b427-a486437eda59 tempest-TestInstancesWithCinderVolumes-1677631332 None] Created volume successfully. Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0016efbb-86de-400b-b577-8dc59df84b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b83a4ec-f9ee-4c87-852a-6cf773a24708', 'volume_name': 'volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708', 'volume_size': 1, 'image_id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--18567685', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec90ea63c4d34e6d82763b34a81f7c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'created_at': datetime.datetime(2025, 9, 25, 19, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8871736-2246-44c8-a14b-5fc140449073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8871736-2246-44c8-a14b-5fc140449073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05a10f3-8844-4208-ae43-dc9ac977cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:27:49 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708', 'volume_size': 1, 'image_id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--18567685', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec90ea63c4d34e6d82763b34a81f7c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'created_at': datetime.datetime(2025, 9, 25, 19, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2/file', 'properties': {}}, 'image_service': } Sep 25 21:27:49 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Cloning 2b83a4ec-f9ee-4c87-852a-6cf773a24708 from image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:27:51 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD, size 20.69 MB, duration 1.53 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:27:51 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Image download 20.69 MB at 13.53 MB/s Sep 25 21:27:51 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848c76a-df25-4605-9fce-b1c86f86246c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:27:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:51 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD Sep 25 21:27:51 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:27:53 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Sep 25 21:27:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD" returned: 0 in 2.218s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:53 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Temporary image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 is fetched for user 7544a0c4f39a486ba73b86021805e60b. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:27:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2787f51d-a260-4f98-bc70-780652a21fbb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:27:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:54 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD Sep 25 21:27:54 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:27:56 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD" returned: 0 in 2.134s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609587975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83a4ec-f9ee-4c87-852a-6cf773a24708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90ea63c4d34e6d82763b34a81f7c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:27:48Z,use_quota=True,user_id='7544a0c4f39a486ba73b86021805e60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a39c0b2-77d0-4815-9e6e-391b3e23a934),volume_type_id=5a39c0b2-77d0-4815-9e6e-391b3e23a934)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Creating volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:27:56 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:56 devstack quobyte-client[84349]: System call of process 94695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:56 devstack quobyte-client[84349]: System call of process 94695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:56 devstack quobyte-client[84349]: System call of process 94695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:56 devstack quobyte-client[84349]: System call of process 94695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:56 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=53, name=volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 1073741824" returned: 0 in 0.372s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 0.115s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:27:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:27:57 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Attempting download of 08a567d9-abe1-4d37-ac71-b1662dbc42b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}])) to volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:27:57 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10d872-4410-46b2-b544-0246e9a67fc4]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:27:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08a567d9-abe1-4d37-ac71-b1662dbc42b2_2g006w_u {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08a567d9-abe1-4d37-ac71-b1662dbc42b2_2g006w_u" returned: 0 in 0.462s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08a567d9-abe1-4d37-ac71-b1662dbc42b2_2g006w_u {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08a567d9-abe1-4d37-ac71-b1662dbc42b2_2g006w_u" returned: 1 in 0.423s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08a567d9-abe1-4d37-ac71-b1662dbc42b2_2g006w_u' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f4f047-8385-40da-a4c5-00d1af653a32]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] 08a567d9-abe1-4d37-ac71-b1662dbc42b2 was qcow2, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:27:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:58 devstack quobyte-client[84349]: System call of process 94706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:58 devstack quobyte-client[84349]: System call of process 94706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:58 devstack quobyte-client[84349]: System call of process 94706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:27:58 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=53, name=volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:27:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 1.054s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:27:59 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08a567d9-abe1-4d37-ac71-b1662dbc42b2_3sw3f3tbdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:27:59 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Converted 112.00 MB image at 102.46 MB/s Sep 25 21:27:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:27:59 devstack quobyte-client[84349]: System call of process 94713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 1G" returned: 0 in 0.185s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a8b73d-b925-422b-9c52-1080ee737578]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-dfaed2ca-5056-4b90-8fa2-768f6b6a3da2 req-c344ab83-d2e4-4cd1-b058-f900593eb075 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-dfaed2ca-5056-4b90-8fa2-768f6b6a3da2 req-c344ab83-d2e4-4cd1-b058-f900593eb075 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-dfaed2ca-5056-4b90-8fa2-768f6b6a3da2 req-c344ab83-d2e4-4cd1-b058-f900593eb075 tempest-AttachVolumeTestJSON-860812365 None] Terminate volume connection completed successfully. Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-dfaed2ca-5056-4b90-8fa2-768f6b6a3da2 req-c344ab83-d2e4-4cd1-b058-f900593eb075 tempest-AttachVolumeTestJSON-860812365 None] Deleting attachment cac67648-cf91-4991-b6e0-cc2abce4d8b4. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:28:00 devstack quobyte-client[84349]: System call of process 94718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:00 devstack quobyte-client[84349]: System call of process 94718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 0.749s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:01 devstack quobyte-client[84349]: System call of process 94720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:01 devstack quobyte-client[84349]: System call of process 94720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 1 in 0.823s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:28:01 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Downloaded image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}])) to volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:28:01 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Temporary image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 for user 7544a0c4f39a486ba73b86021805e60b is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:28:01 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Marking volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Copying metadata from image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 to 2b83a4ec-f9ee-4c87-852a-6cf773a24708. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Creating volume glance metadata for volume 2b83a4ec-f9ee-4c87-852a-6cf773a24708 backed by image 08a567d9-abe1-4d37-ac71-b1662dbc42b2 with: {'image_id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'image_name': 'tempest-scenario-img--18567685', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05a10f3-8844-4208-ae43-dc9ac977cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708', 'volume_size': 1, 'image_id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--18567685', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec90ea63c4d34e6d82763b34a81f7c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08a567d9-abe1-4d37-ac71-b1662dbc42b2', 'created_at': datetime.datetime(2025, 9, 25, 19, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08a567d9-abe1-4d37-ac71-b1662dbc42b2/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9ae4f3-26c4-4d25-934b-322c932ed478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 (2b83a4ec-f9ee-4c87-852a-6cf773a24708): created successfully Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9ae4f3-26c4-4d25-934b-322c932ed478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Flow 'volume_create_manager' (560d204a-9b23-469c-a431-16d30037f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-928b1706-f17a-4616-bf02-3b1dcf85eefe tempest-TestInstancesWithCinderVolumes-1677631332 None] Created volume successfully. Sep 25 21:28:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Flow 'volume_create_manager' (b42d9cc3-3235-4428-8807-19875054c9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ec4c2-d74f-4e8a-9731-008dd340c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ec4c2-d74f-4e8a-9731-008dd340c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-120531124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f859ae-0d95-4f09-90bf-25cfc1ece3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5fe3a24e74a11b54a8d8fd659bd35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:05Z,use_quota=True,user_id='279f4c75c2e6467990e77a4ba1a385af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9245382-04a5-4f43-94e3-0966b01fdeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9245382-04a5-4f43-94e3-0966b01fdeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48e8a4c-f411-4c08-a693-227fc97a1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48e8a4c-f411-4c08-a693-227fc97a1c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f859ae-0d95-4f09-90bf-25cfc1ece3e8', 'volume_name': 'volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc8ec9e-8a7b-44ad-8be5-58016eb3596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc8ec9e-8a7b-44ad-8be5-58016eb3596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9752c9-f107-4501-be08-09dd0221cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume c7f859ae-0d95-4f09-90bf-25cfc1ece3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8', 'volume_size': 1} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-120531124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f859ae-0d95-4f09-90bf-25cfc1ece3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5fe3a24e74a11b54a8d8fd659bd35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:05Z,use_quota=True,user_id='279f4c75c2e6467990e77a4ba1a385af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Creating volume c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:28:05 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:05 devstack quobyte-client[84349]: System call of process 94792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:05 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=54, name=volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 1073741824" returned: 0 in 0.437s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9752c9-f107-4501-be08-09dd0221cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9adfae4-9d46-453c-befc-eac9cb049fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:06 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 (c7f859ae-0d95-4f09-90bf-25cfc1ece3e8): created successfully Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9adfae4-9d46-453c-befc-eac9cb049fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:06 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Flow 'volume_create_manager' (b42d9cc3-3235-4428-8807-19875054c9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-70fd203e-8ac8-4f42-b140-e5db698ec5f3 tempest-SnapshotMetadataTestJSON-1913044714 None] Created volume successfully. Sep 25 21:28:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Creating offline snapshot 2035bacb-3ffd-4098-ae28-bef92dfa646c of volume c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:28:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d17fde-f601-4eae-90d6-141590930ebe]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:08 devstack quobyte-client[84349]: System call of process 94799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" returned: 0 in 0.492s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:08 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=55, name=volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c 1G" returned: 0 in 0.342s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "qemu-img rebase -u -b volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 0.150s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 0.139s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:28:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.info" returned: 0 in 0.089s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.info" returned: 0 in 0.078s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.748s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:09 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d26c906a-ebd9-45ea-9363-c6301ce59eb0 tempest-SnapshotMetadataTestJSON-1913044714 None] Create snapshot completed successfully Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "cinder-2035bacb-3ffd-4098-ae28-bef92dfa646c-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-2035bacb-3ffd-4098-ae28-bef92dfa646c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "cinder-quobyte-2035bacb-3ffd-4098-ae28-bef92dfa646c" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-2035bacb-3ffd-4098-ae28-bef92dfa646c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Deleting offline snapshot 2035bacb-3ffd-4098-ae28-bef92dfa646c of volume c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] snapshot_file for this snap is: volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b18e01-9097-49db-9c76-d862f2848b91]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:13 devstack quobyte-client[84349]: System call of process 94815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 1.028s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:28:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db0329-a320-46f0-8eb6-89749f83436b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:14 devstack quobyte-client[84349]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" returned: 0 in 0.885s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:15 devstack quobyte-client[84349]: System call of process 94837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:15 devstack quobyte-client[84349]: System call of process 94837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 0.382s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8.2035bacb-3ffd-4098-ae28-bef92dfa646c" returned: 0 in 0.720s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a02a360-e9db-4c96-a8cd-137edcbe2191]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-2035bacb-3ffd-4098-ae28-bef92dfa646c" released by "_delete_snapshot" :: held 3.743s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" released by "delete_snapshot" :: held 3.872s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:16 devstack quobyte-client[84349]: System call of process 94846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:16 devstack quobyte-client[84349]: System call of process 94846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:16 devstack quobyte-client[84349]: System call of process 94846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 0.783s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:17 devstack quobyte-client[84349]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:17 devstack quobyte-client[84349]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:17 devstack quobyte-client[84349]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 1 in 1.060s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Created reservations ['94c5a47f-d5e0-45a3-b2d9-83bee2ff3868', '63c75884-fe42-44d1-8254-a05c60779eb6', 'f1a60ada-001a-4624-874b-ecdf4ce50fe8', '7087e23e-892a-4db3-b37a-878d917f4e53'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '383ad436-d252-40af-9cb2-a45d88d4db94', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:28:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-780b4ba3-ce14-4240-bb51-eb833e6fe2a3 req-6fa0f591-5a9d-461f-8838-2e3f960ea808 tempest-TestInstancesWithCinderVolumes-1677631332 None] attachment_update completed successfully. Sep 25 21:28:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Delete snapshot completed successfully. Sep 25 21:28:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3fc9ab6-dde4-4f73-80f0-f5cdf88f77fc tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-2035bacb-3ffd-4098-ae28-bef92dfa646c-delete_snapshot" released by "delete_snapshot" :: held 5.960s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "cinder-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:19 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" acquired by "delete_volume" :: waited 0.016s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e221e0-fa96-422d-936f-6bf1d62500d5]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" returned: 0 in 1.730s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" returned: 0 in 0.640s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-quobyte-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8" released by "delete_volume" :: held 2.865s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Created reservations ['3e318f1c-7f46-46fa-9383-5e4d58d55d94', '89203713-1a88-4764-b98e-9634b2ff9bd0', 'b2175536-6d9d-4306-bbe3-11416faa55c7', '78b6fa65-8a85-4061-a6c8-6a2b93374bca'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:28:23 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Deleted volume successfully. Sep 25 21:28:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-678c6cb4-fe3f-4cbc-8eb7-e97d461337a0 tempest-SnapshotMetadataTestJSON-1913044714 None] Lock "cinder-c7f859ae-0d95-4f09-90bf-25cfc1ece3e8-delete_volume" released by "delete_volume" :: held 4.506s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:33 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=34,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:28:33 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=28,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:28:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Flow 'volume_create_manager' (d137f429-afed-4510-98e1-2b31ee0ea5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74feecf5-1aae-47e3-9059-2ec65175eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74feecf5-1aae-47e3-9059-2ec65175eb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-376776685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58407832-ff5f-4b5a-af35-9af34eda62f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8302a7b278664ed7b5ba97fe80441e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:37Z,use_quota=True,user_id='2dbecd9ae9834c5ba81f63aa3af0f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13375801-c482-4dbc-8e63-e64e7786e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13375801-c482-4dbc-8e63-e64e7786e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b5a1d-4a8f-4473-9766-c0ac130cb03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b5a1d-4a8f-4473-9766-c0ac130cb03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58407832-ff5f-4b5a-af35-9af34eda62f2', 'volume_name': 'volume-58407832-ff5f-4b5a-af35-9af34eda62f2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d6cc4-db92-487e-a166-85fd76cd7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d6cc4-db92-487e-a166-85fd76cd7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86433676-a81c-4cac-a9a9-c44387a60317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:37 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Volume 58407832-ff5f-4b5a-af35-9af34eda62f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58407832-ff5f-4b5a-af35-9af34eda62f2', 'volume_size': 1} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-376776685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58407832-ff5f-4b5a-af35-9af34eda62f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8302a7b278664ed7b5ba97fe80441e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:37Z,use_quota=True,user_id='2dbecd9ae9834c5ba81f63aa3af0f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Creating volume 58407832-ff5f-4b5a-af35-9af34eda62f2 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:28:37 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:28:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:37 devstack quobyte-client[84349]: System call of process 95405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:37 devstack quobyte-client[84349]: System call of process 95405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:37 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=57, name=volume-58407832-ff5f-4b5a-af35-9af34eda62f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:28:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2 1073741824" returned: 0 in 0.764s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2" returned: 0 in 0.413s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] <== create_volume: return (1369ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:28:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86433676-a81c-4cac-a9a9-c44387a60317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58407832-ff5f-4b5a-af35-9af34eda62f2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a976a311-eb12-4fad-95b9-c5d806bc67d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:39 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Volume volume-58407832-ff5f-4b5a-af35-9af34eda62f2 (58407832-ff5f-4b5a-af35-9af34eda62f2): created successfully Sep 25 21:28:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a976a311-eb12-4fad-95b9-c5d806bc67d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Flow 'volume_create_manager' (d137f429-afed-4510-98e1-2b31ee0ea5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5681cc6f-a372-4a30-898b-2cd0107892f0 tempest-VolumesTransfersV355Test-1239207080 None] Created volume successfully. Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.276s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:28:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3af74632-3ab2-436a-84c4-0a260d561946 tempest-VolumesTransfersV355Test-446760409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3af74632-3ab2-436a-84c4-0a260d561946 tempest-VolumesTransfersV355Test-446760409 None] Transfer volume completed successfully. Sep 25 21:28:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "cinder-58407832-ff5f-4b5a-af35-9af34eda62f2-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-58407832-ff5f-4b5a-af35-9af34eda62f2-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:45 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "cinder-quobyte-58407832-ff5f-4b5a-af35-9af34eda62f2" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-quobyte-58407832-ff5f-4b5a-af35-9af34eda62f2" acquired by "delete_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:45 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3301512-be38-4ed5-94a1-421cf4e05c2d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:46 devstack quobyte-client[84349]: System call of process 95443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:46 devstack quobyte-client[84349]: System call of process 95443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:46 devstack quobyte-client[84349]: System call of process 95443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:46 devstack quobyte-client[84349]: System call of process 95443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2" returned: 0 in 1.705s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-58407832-ff5f-4b5a-af35-9af34eda62f2" returned: 0 in 0.406s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-quobyte-58407832-ff5f-4b5a-af35-9af34eda62f2" released by "delete_volume" :: held 2.787s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Created reservations ['803eeebb-0541-4a6e-aa0a-08208cabd295', 'e4f18318-ad3c-4bf8-8efa-71c997969994', '2180c1ed-b387-42e7-99e7-09a4249e69a4', '4b168743-fdd1-421e-b1ef-bef47fc8bc24'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.210s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:49 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:28:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Deleted volume successfully. Sep 25 21:28:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b2b3bc3d-bc3c-4cc7-89cf-1cb5027f7fbb tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-58407832-ff5f-4b5a-af35-9af34eda62f2-delete_volume" released by "delete_volume" :: held 4.730s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:51 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:28:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Flow 'volume_create_manager' (dd26f326-faa2-4aa5-a917-0a19c7794f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0d56f4-225a-46de-8d95-b0e3ca3040b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0d56f4-225a-46de-8d95-b0e3ca3040b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-923567655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8db346b-3417-4987-97a7-ba8034646b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8302a7b278664ed7b5ba97fe80441e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:51Z,use_quota=True,user_id='2dbecd9ae9834c5ba81f63aa3af0f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f52e26-1fcf-4802-bee4-e8ccfd84ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f52e26-1fcf-4802-bee4-e8ccfd84ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf01e207-f4b7-459b-819c-f970f6856645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf01e207-f4b7-459b-819c-f970f6856645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8db346b-3417-4987-97a7-ba8034646b63', 'volume_name': 'volume-a8db346b-3417-4987-97a7-ba8034646b63', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9790f1d-ab72-45c2-a208-6330f03ba11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9790f1d-ab72-45c2-a208-6330f03ba11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed9abd-d6e9-43f3-9da0-92b3fbcf372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Volume a8db346b-3417-4987-97a7-ba8034646b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8db346b-3417-4987-97a7-ba8034646b63', 'volume_size': 1} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-923567655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8db346b-3417-4987-97a7-ba8034646b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8302a7b278664ed7b5ba97fe80441e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:28:51Z,use_quota=True,user_id='2dbecd9ae9834c5ba81f63aa3af0f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Creating volume a8db346b-3417-4987-97a7-ba8034646b63 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:28:52 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:28:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:52 devstack quobyte-client[84349]: System call of process 95448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:52 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=58, name=volume-a8db346b-3417-4987-97a7-ba8034646b63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:28:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63 1073741824" returned: 0 in 1.408s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63" returned: 0 in 0.192s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] <== create_volume: return (1816ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed9abd-d6e9-43f3-9da0-92b3fbcf372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8db346b-3417-4987-97a7-ba8034646b63', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463c80c-26ad-4e7d-b511-c8c0c640015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:28:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Volume volume-a8db346b-3417-4987-97a7-ba8034646b63 (a8db346b-3417-4987-97a7-ba8034646b63): created successfully Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463c80c-26ad-4e7d-b511-c8c0c640015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:28:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Flow 'volume_create_manager' (dd26f326-faa2-4aa5-a917-0a19c7794f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:28:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ff54d3e7-f1f0-4cc7-b161-635b9ad0210f tempest-VolumesTransfersV355Test-1239207080 None] Created volume successfully. Sep 25 21:28:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "cinder-a8db346b-3417-4987-97a7-ba8034646b63-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-a8db346b-3417-4987-97a7-ba8034646b63-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:57 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "cinder-quobyte-a8db346b-3417-4987-97a7-ba8034646b63" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-quobyte-a8db346b-3417-4987-97a7-ba8034646b63" acquired by "delete_volume" :: waited 0.024s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce0f89b-6501-4a47-8054-d0336d1d68e9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:57 devstack quobyte-client[84349]: System call of process 95455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:57 devstack quobyte-client[84349]: System call of process 95455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63" returned: 0 in 0.647s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a8db346b-3417-4987-97a7-ba8034646b63" returned: 0 in 0.167s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-quobyte-a8db346b-3417-4987-97a7-ba8034646b63" released by "delete_volume" :: held 1.034s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Created reservations ['a56b3430-dd82-42ac-b762-47793ca6e528', 'bf581001-196b-4793-9f45-53cfa747d6f6', 'afa43a0e-3d7e-457c-8be4-dcb39ca0b261', 'c72f9b21-2d20-44de-a0de-8cada0f34442'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.169s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:28:58 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:28:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Deleted volume successfully. Sep 25 21:28:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-36d25c6a-2116-4761-b0e2-f56414300fec tempest-VolumesTransfersV355Test-1390419630 None] Lock "cinder-a8db346b-3417-4987-97a7-ba8034646b63-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (0046360f-2f2f-4b07-8e14-3b3d4357c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495c605-5fc8-4ac4-8ed7-dd1c9d3415f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495c605-5fc8-4ac4-8ed7-dd1c9d3415f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1518827391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05852a6b-31c1-4d60-9053-49ace691732d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:07Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573cdf49-658b-4a71-aa73-7eb4aa2f6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573cdf49-658b-4a71-aa73-7eb4aa2f6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c5d3ae-c5f7-43ea-932e-33c22f808426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c5d3ae-c5f7-43ea-932e-33c22f808426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05852a6b-31c1-4d60-9053-49ace691732d', 'volume_name': 'volume-05852a6b-31c1-4d60-9053-49ace691732d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ea6cad-10b7-4caa-b66d-32dd49908aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ea6cad-10b7-4caa-b66d-32dd49908aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614f4a89-7230-404a-84fb-b87f8a9ec235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:07 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Volume 05852a6b-31c1-4d60-9053-49ace691732d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05852a6b-31c1-4d60-9053-49ace691732d', 'volume_size': 1} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1518827391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05852a6b-31c1-4d60-9053-49ace691732d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:07Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Creating volume 05852a6b-31c1-4d60-9053-49ace691732d {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:29:07 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:29:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:07 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=59, name=volume-05852a6b-31c1-4d60-9053-49ace691732d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d 1073741824" returned: 0 in 0.400s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d" returned: 0 in 0.129s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614f4a89-7230-404a-84fb-b87f8a9ec235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05852a6b-31c1-4d60-9053-49ace691732d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4fefcc-6cfa-4641-9d0f-e0e4995fdd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Volume volume-05852a6b-31c1-4d60-9053-49ace691732d (05852a6b-31c1-4d60-9053-49ace691732d): created successfully Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4fefcc-6cfa-4641-9d0f-e0e4995fdd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (0046360f-2f2f-4b07-8e14-3b3d4357c814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-39359adb-3e54-47ca-957b-e0a87f06dd68 tempest-VolumesListTestJSON-2137344132 None] Created volume successfully. Sep 25 21:29:10 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (7b93172c-e069-4f84-810a-eb4236c4dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28943393-9d51-4eca-8a14-e777303bc297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28943393-9d51-4eca-8a14-e777303bc297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-132196145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc13877-96df-4283-b779-d93a41e4a9b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:10Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f204fc-d900-45c3-af84-109112d0a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f204fc-d900-45c3-af84-109112d0a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb31f4b-1009-446a-ab37-02135261408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb31f4b-1009-446a-ab37-02135261408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc13877-96df-4283-b779-d93a41e4a9b2', 'volume_name': 'volume-6fc13877-96df-4283-b779-d93a41e4a9b2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150706cf-98e7-4f78-b6c0-a9c313ea08a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150706cf-98e7-4f78-b6c0-a9c313ea08a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0769d832-8872-47ab-8e00-cf6bcd998bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:10 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Volume 6fc13877-96df-4283-b779-d93a41e4a9b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc13877-96df-4283-b779-d93a41e4a9b2', 'volume_size': 1} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-132196145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc13877-96df-4283-b779-d93a41e4a9b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:10Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Creating volume 6fc13877-96df-4283-b779-d93a41e4a9b2 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:29:10 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=60, name=volume-6fc13877-96df-4283-b779-d93a41e4a9b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2 1073741824" returned: 0 in 0.395s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] <== create_volume: return (570ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:29:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0769d832-8872-47ab-8e00-cf6bcd998bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc13877-96df-4283-b779-d93a41e4a9b2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa9fdfd-7a9f-4a09-a7fc-cf53c88201dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:11 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Volume volume-6fc13877-96df-4283-b779-d93a41e4a9b2 (6fc13877-96df-4283-b779-d93a41e4a9b2): created successfully Sep 25 21:29:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa9fdfd-7a9f-4a09-a7fc-cf53c88201dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (7b93172c-e069-4f84-810a-eb4236c4dde9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-37440d4d-d015-4792-84ef-29f356bd9720 tempest-VolumesListTestJSON-2137344132 None] Created volume successfully. Sep 25 21:29:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (a24a843d-3098-4966-899e-941f9d2bec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c468e2b3-1ab8-4408-aa61-b69e75d7122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c468e2b3-1ab8-4408-aa61-b69e75d7122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-723577463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271be208-a380-44e3-b16c-b3de953df08d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:13Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0ab346-6127-47d9-9611-2f1d02666ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0ab346-6127-47d9-9611-2f1d02666ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302c3dc-de9f-462b-825f-e2381abb5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302c3dc-de9f-462b-825f-e2381abb5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271be208-a380-44e3-b16c-b3de953df08d', 'volume_name': 'volume-271be208-a380-44e3-b16c-b3de953df08d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0eac527-4d60-4b74-9c87-d5a371c3c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0eac527-4d60-4b74-9c87-d5a371c3c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7a7dc5-1d41-439b-b28b-7c46ec3687a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Volume 271be208-a380-44e3-b16c-b3de953df08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271be208-a380-44e3-b16c-b3de953df08d', 'volume_size': 1} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-723577463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271be208-a380-44e3-b16c-b3de953df08d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d187cb9ae234ceea662f90856adb0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:29:13Z,use_quota=True,user_id='23de15cada7c4228aff38111db746c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Creating volume 271be208-a380-44e3-b16c-b3de953df08d {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:29:12 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:29:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:13 devstack quobyte-client[84349]: System call of process 95519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:13 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=61, name=volume-271be208-a380-44e3-b16c-b3de953df08d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d 1073741824" returned: 0 in 0.345s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d" returned: 0 in 0.090s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7a7dc5-1d41-439b-b28b-7c46ec3687a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271be208-a380-44e3-b16c-b3de953df08d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090c990-1614-4573-ab30-d4b84f8e1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:29:13 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Volume volume-271be208-a380-44e3-b16c-b3de953df08d (271be208-a380-44e3-b16c-b3de953df08d): created successfully Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090c990-1614-4573-ab30-d4b84f8e1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:29:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Flow 'volume_create_manager' (a24a843d-3098-4966-899e-941f9d2bec3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:29:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3d379d7c-6644-4bc2-a4be-49e8eb0cb34e tempest-VolumesListTestJSON-2137344132 None] Created volume successfully. Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-271be208-a380-44e3-b16c-b3de953df08d-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-271be208-a380-44e3-b16c-b3de953df08d-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-quobyte-271be208-a380-44e3-b16c-b3de953df08d" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-271be208-a380-44e3-b16c-b3de953df08d" acquired by "delete_volume" :: waited 0.022s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae874e8f-e149-468d-8c8a-d9aef838346f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:20 devstack quobyte-client[84349]: System call of process 95533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:20 devstack quobyte-client[84349]: System call of process 95533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:20 devstack quobyte-client[84349]: System call of process 95533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:20 devstack quobyte-client[84349]: System call of process 95533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d" returned: 0 in 0.593s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-271be208-a380-44e3-b16c-b3de953df08d" returned: 0 in 0.177s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-271be208-a380-44e3-b16c-b3de953df08d" released by "delete_volume" :: held 1.093s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Created reservations ['0102e1db-6215-44b3-9663-b20d94358338', 'b9654417-eacf-41e2-aee9-44a0ed903c80', '8f5a9ffd-df36-4133-9e6c-8b108e42c1fa', '4a167f80-e413-4ae1-b2ce-ba3c3985be92'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.140s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:29:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Deleted volume successfully. Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0a6c3729-b381-491e-a9b7-cffe55571620 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-271be208-a380-44e3-b16c-b3de953df08d-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-6fc13877-96df-4283-b779-d93a41e4a9b2-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-6fc13877-96df-4283-b779-d93a41e4a9b2-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-quobyte-6fc13877-96df-4283-b779-d93a41e4a9b2" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-6fc13877-96df-4283-b779-d93a41e4a9b2" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5eb2ec-82f2-4650-bc93-58ce23bf1da2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:29:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:23 devstack quobyte-client[84349]: System call of process 95545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:29:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2" returned: 0 in 0.455s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6fc13877-96df-4283-b779-d93a41e4a9b2" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-6fc13877-96df-4283-b779-d93a41e4a9b2" released by "delete_volume" :: held 0.732s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:23 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Created reservations ['cdf420d6-c0e8-4108-9d70-d90fef0ac890', '1cf152bf-1752-4571-a247-d129fe835651', '2c7e6a49-b0e1-4d46-bd94-a236bd02e966', '66952624-a601-493c-ac16-b7458abdf3e0'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.128s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:29:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Deleted volume successfully. Sep 25 21:29:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c5623790-17f8-46d3-ab62-dba837fe3ad6 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-6fc13877-96df-4283-b779-d93a41e4a9b2-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-05852a6b-31c1-4d60-9053-49ace691732d-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-05852a6b-31c1-4d60-9053-49ace691732d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "cinder-quobyte-05852a6b-31c1-4d60-9053-49ace691732d" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-05852a6b-31c1-4d60-9053-49ace691732d" acquired by "delete_volume" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7cf4d0-f2bc-4f23-ab94-5238938e2cbf]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d" returned: 0 in 0.425s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-05852a6b-31c1-4d60-9053-49ace691732d" returned: 0 in 0.095s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-quobyte-05852a6b-31c1-4d60-9053-49ace691732d" released by "delete_volume" :: held 0.688s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Created reservations ['c61207de-c7a0-4d1e-b750-445679ac2f7e', 'eba61362-3d7a-40eb-872f-69d9b8e07896', '3104d31d-72d7-4d79-993d-b3cc3ca11a7f', '43fd4d9b-b62d-47de-a516-a434684302e5'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.096s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:29:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Deleted volume successfully. Sep 25 21:29:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d69e9e7-dfa2-4324-8f3f-762e67bfa0a3 tempest-VolumesListTestJSON-2137344132 None] Lock "cinder-05852a6b-31c1-4d60-9053-49ace691732d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:29:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=39,cinder:SELECT=27,cinder:INSERT=13,cinder:DELETE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:29:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=34,cinder:UPDATE=61,cinder:DELETE=7,cinder:INSERT=7 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.288s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:29:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:29:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:29:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:30:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[422647b3-e8f1-47fa-995e-717b17e03c37]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:30:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:03 devstack quobyte-client[84349]: System call of process 95667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:30:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71" returned: 0 in 0.569s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.636s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-73981628-ff1f-4270-ade6-bd27029f9f71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78725436-1151-4452-81c2-04e30b27f13d', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:30:03 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:30:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5be9bb2f-0b7d-427b-9ae3-5dd9aaec8579 req-da0f2517-0544-48cf-8e5d-e6e7870cd1c6 tempest-TestInstancesWithCinderVolumes-1677631332 None] attachment_update completed successfully. Sep 25 21:30:13 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:30:13 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:30:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e893fc-1a66-4a31-bd32-629b32b1118b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:30:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:23 devstack quobyte-client[84349]: System call of process 95838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:30:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" returned: 0 in 1.392s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.534s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '015d762a-87db-46ca-b53f-622b0b49c207', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:30:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:30:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-6b4e2f57-cf58-4e30-9ca6-7de4fdaa710e req-4a0dea25-f1c8-4a85-b296-5e4dc8abdee0 tempest-TestInstancesWithCinderVolumes-1677631332 None] attachment_update completed successfully. Sep 25 21:30:34 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:30:34 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.229s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:30:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Flow 'volume_create_manager' (9ffcc2ca-6829-429e-973f-983af5b88a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82fd7d-c940-471f-bac2-c61ab0d0230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82fd7d-c940-471f-bac2-c61ab0d0230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-837717303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb112421-a90c-4fa6-a578-04aecfbb62dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e374bd671446e08ed1d877331d9347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:30:42Z,use_quota=True,user_id='ebbbee3bc5324e4ea633b6904e95b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4ae2f4-f02c-4838-bfcd-7e47ecf45f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4ae2f4-f02c-4838-bfcd-7e47ecf45f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e03f709-053b-4510-8e46-f52968da3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e03f709-053b-4510-8e46-f52968da3984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb112421-a90c-4fa6-a578-04aecfbb62dc', 'volume_name': 'volume-eb112421-a90c-4fa6-a578-04aecfbb62dc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2af0ce8-a09a-4618-8fe7-4a4c2b972c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2af0ce8-a09a-4618-8fe7-4a4c2b972c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca807cc-7a50-4acd-8e96-78a5336d449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:42 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Volume eb112421-a90c-4fa6-a578-04aecfbb62dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb112421-a90c-4fa6-a578-04aecfbb62dc', 'volume_size': 1} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-837717303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb112421-a90c-4fa6-a578-04aecfbb62dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e374bd671446e08ed1d877331d9347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:30:42Z,use_quota=True,user_id='ebbbee3bc5324e4ea633b6904e95b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Creating volume eb112421-a90c-4fa6-a578-04aecfbb62dc {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:30:42 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:30:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:43 devstack quobyte-client[84349]: System call of process 95976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:30:43 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=62, name=volume-eb112421-a90c-4fa6-a578-04aecfbb62dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:30:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc 1073741824" returned: 0 in 0.881s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc" returned: 0 in 0.157s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] <== create_volume: return (1241ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca807cc-7a50-4acd-8e96-78a5336d449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb112421-a90c-4fa6-a578-04aecfbb62dc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8274ba07-eb03-4e21-b1b6-a4a2b398e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:30:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Volume volume-eb112421-a90c-4fa6-a578-04aecfbb62dc (eb112421-a90c-4fa6-a578-04aecfbb62dc): created successfully Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8274ba07-eb03-4e21-b1b6-a4a2b398e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:30:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Flow 'volume_create_manager' (9ffcc2ca-6829-429e-973f-983af5b88a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:30:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3e25be54-27bc-41f7-804f-7669a076a63d tempest-TestMinimumBasicScenario-1479618749 None] Created volume successfully. Sep 25 21:30:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:30:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:30:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab89de85-e8c9-49e2-82e7-c81750101f18]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:30:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:30:49 devstack quobyte-client[84349]: System call of process 95993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:30:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc" returned: 0 in 0.647s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:30:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.731s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:30:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-eb112421-a90c-4fa6-a578-04aecfbb62dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b62b5686-ff12-4fb0-8448-e57280b48dbd', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:30:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:30:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-051cc926-d123-4ea0-8956-6d061e8529a2 req-e8cc860e-97e3-42ec-b9b3-849d85d2f260 tempest-TestMinimumBasicScenario-1479618749 None] attachment_update completed successfully. Sep 25 21:31:00 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:31:00 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:31:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-88d65aa1-c203-4f93-b4ae-cfe8319eb7a2 req-ee8cfdf3-31b0-4121-9bd3-7ac1b3c24f45 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-88d65aa1-c203-4f93-b4ae-cfe8319eb7a2 req-ee8cfdf3-31b0-4121-9bd3-7ac1b3c24f45 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-88d65aa1-c203-4f93-b4ae-cfe8319eb7a2 req-ee8cfdf3-31b0-4121-9bd3-7ac1b3c24f45 tempest-TestInstancesWithCinderVolumes-1677631332 None] Terminate volume connection completed successfully. Sep 25 21:31:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-88d65aa1-c203-4f93-b4ae-cfe8319eb7a2 req-ee8cfdf3-31b0-4121-9bd3-7ac1b3c24f45 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleting attachment 78725436-1151-4452-81c2-04e30b27f13d. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:31:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-73981628-ff1f-4270-ade6-bd27029f9f71-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-73981628-ff1f-4270-ade6-bd27029f9f71-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-quobyte-73981628-ff1f-4270-ade6-bd27029f9f71" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-73981628-ff1f-4270-ade6-bd27029f9f71" acquired by "delete_volume" :: waited 0.024s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:06 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9710eb4-2725-4688-92e4-96cbd13e0ff2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:31:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:07 devstack quobyte-client[84349]: System call of process 96037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:07 devstack quobyte-client[84349]: System call of process 96037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71" returned: 0 in 1.521s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-73981628-ff1f-4270-ade6-bd27029f9f71" returned: 0 in 0.214s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-73981628-ff1f-4270-ade6-bd27029f9f71" released by "delete_volume" :: held 2.120s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:31:08 devstack cinder-volume[84334]: WARNING cinder.quota [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449884888-534940959 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449884888-534940959, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:31:08 devstack cinder-volume[84334]: WARNING cinder.quota [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449884888-534940959 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449884888-534940959, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Created reservations ['02dd14c6-2bfe-464a-a6a7-c4bc7fcc715f', 'f33562df-985b-4072-984c-57a1b49fa12c', '768c8159-593d-4a09-9170-fe3609636aa2', '2ee24130-3f18-420e-87e4-1fcb6318c784'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.144s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:08 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:31:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleted volume successfully. Sep 25 21:31:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46b766fb-3504-49ff-8e70-e60d53ea2205 tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-73981628-ff1f-4270-ade6-bd27029f9f71-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:31:18 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:31:19 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:31:30 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (fea0c221-ae24-477b-a68b-f723a6a29ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34163f6-1c31-41cf-b53e-0b22b10f1340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34163f6-1c31-41cf-b53e-0b22b10f1340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1024018272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ada0f38-afe5-47a6-97fb-95370b14ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:31:30Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6187a9f-e507-4e44-a789-946d19e65e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6187a9f-e507-4e44-a789-946d19e65e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49252135-a99c-4739-9683-dc437ba7312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49252135-a99c-4739-9683-dc437ba7312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ada0f38-afe5-47a6-97fb-95370b14ef01', 'volume_name': 'volume-0ada0f38-afe5-47a6-97fb-95370b14ef01', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a39332b-37f4-4c33-8085-4ab35cd3238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a39332b-37f4-4c33-8085-4ab35cd3238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5411019c-da8b-40ad-82b9-02ab1743b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:30 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Volume 0ada0f38-afe5-47a6-97fb-95370b14ef01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ada0f38-afe5-47a6-97fb-95370b14ef01', 'volume_size': 1} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1024018272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ada0f38-afe5-47a6-97fb-95370b14ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:31:30Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Creating volume 0ada0f38-afe5-47a6-97fb-95370b14ef01 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:31:30 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:30 devstack quobyte-client[84349]: System call of process 96167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:30 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=63, name=volume-0ada0f38-afe5-47a6-97fb-95370b14ef01, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 1073741824" returned: 0 in 0.412s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01" returned: 0 in 0.133s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] <== create_volume: return (624ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:31:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5411019c-da8b-40ad-82b9-02ab1743b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ada0f38-afe5-47a6-97fb-95370b14ef01', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58d9159-307f-4474-9ca0-3cced06dba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:31 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Volume volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 (0ada0f38-afe5-47a6-97fb-95370b14ef01): created successfully Sep 25 21:31:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58d9159-307f-4474-9ca0-3cced06dba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (fea0c221-ae24-477b-a68b-f723a6a29ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:31:31 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-777519fa-4de4-463f-8b89-3790f2668303 tempest-AttachVolumeTestJSON-860812365 None] Created volume successfully. Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[55431b66-62be-4fb9-91f9-f6750c5ec69d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:36 devstack quobyte-client[84349]: System call of process 96195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:36 devstack quobyte-client[84349]: System call of process 96195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:36 devstack quobyte-client[84349]: System call of process 96195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01" returned: 0 in 0.489s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.557s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-0ada0f38-afe5-47a6-97fb-95370b14ef01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7709acd0-fd08-4ae9-bc08-b4476700d5cb', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:31:36 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-f168e172-618d-46a8-be64-d54625d831fc req-628ad4fa-52d9-4d4a-8e7b-2fa120398586 tempest-AttachVolumeTestJSON-860812365 None] attachment_update completed successfully. Sep 25 21:31:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-a4d3f60b-20fb-4986-a2d8-b4ce6dfd9b87 req-50e66ba8-66df-4501-bbae-af7b61e44a24 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-a4d3f60b-20fb-4986-a2d8-b4ce6dfd9b87 req-50e66ba8-66df-4501-bbae-af7b61e44a24 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:38 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-a4d3f60b-20fb-4986-a2d8-b4ce6dfd9b87 req-50e66ba8-66df-4501-bbae-af7b61e44a24 tempest-TestInstancesWithCinderVolumes-1677631332 None] Terminate volume connection completed successfully. Sep 25 21:31:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-a4d3f60b-20fb-4986-a2d8-b4ce6dfd9b87 req-50e66ba8-66df-4501-bbae-af7b61e44a24 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleting attachment 015d762a-87db-46ca-b53f-622b0b49c207. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.105s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-eb91075f-ec47-4afd-aa87-0c462cb2d9cb-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-eb91075f-ec47-4afd-aa87-0c462cb2d9cb-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-quobyte-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa85ce3-53b1-40e4-8482-bde4a8d7c25e]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:31:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:42 devstack quobyte-client[84349]: System call of process 96216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:42 devstack quobyte-client[84349]: System call of process 96216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:42 devstack quobyte-client[84349]: System call of process 96216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" returned: 0 in 0.719s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" returned: 0 in 0.375s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-eb91075f-ec47-4afd-aa87-0c462cb2d9cb" released by "delete_volume" :: held 1.423s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:31:43 devstack cinder-volume[84334]: WARNING cinder.quota [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1421072707-849218802 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1421072707-849218802, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:31:43 devstack cinder-volume[84334]: WARNING cinder.quota [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1421072707-849218802 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1421072707-849218802, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Created reservations ['47e6763f-3b86-409f-8853-c3511a4dcd66', '41ac1659-b52b-417e-a076-3af8afada5cd', '25bc456e-8255-48e1-af41-95c52d8725ba', '30f4a031-634f-4e91-b581-70cefda43b24'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.720s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:31:44 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (eebdf7c7-91e4-42a8-92f1-f701321c32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484b507e-519e-45fc-af8f-159791a75c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleted volume successfully. Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484b507e-519e-45fc-af8f-159791a75c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-303373872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67023825-1d35-4c07-9ec6-88f006452ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:31:44Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb637eeb-9f75-4778-b7e9-644034e98148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb637eeb-9f75-4778-b7e9-644034e98148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c759afe-5a83-4795-953b-b4eea1661842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c759afe-5a83-4795-953b-b4eea1661842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67023825-1d35-4c07-9ec6-88f006452ae3', 'volume_name': 'volume-67023825-1d35-4c07-9ec6-88f006452ae3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafcd2b0-9203-40ce-aaef-738991c45cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafcd2b0-9203-40ce-aaef-738991c45cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2accc56a-36a6-44dd-91d9-c6a7fb9bcc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:45 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Volume 67023825-1d35-4c07-9ec6-88f006452ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67023825-1d35-4c07-9ec6-88f006452ae3', 'volume_size': 1} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-303373872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67023825-1d35-4c07-9ec6-88f006452ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7285eb3869f453dbf0af180645ad49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:31:44Z,use_quota=True,user_id='44bfa54aecfa4e22904be88f60a788c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Creating volume 67023825-1d35-4c07-9ec6-88f006452ae3 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:31:45 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:45 devstack quobyte-client[84349]: System call of process 96224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:45 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=64, name=volume-67023825-1d35-4c07-9ec6-88f006452ae3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d28818c-1bdf-4607-ac5e-f35446b21b0f tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-eb91075f-ec47-4afd-aa87-0c462cb2d9cb-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 1073741824" returned: 0 in 0.572s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3" returned: 0 in 0.351s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] <== create_volume: return (1066ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2accc56a-36a6-44dd-91d9-c6a7fb9bcc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67023825-1d35-4c07-9ec6-88f006452ae3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cded2caa-a7d1-4043-9492-979eeabc954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:31:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Volume volume-67023825-1d35-4c07-9ec6-88f006452ae3 (67023825-1d35-4c07-9ec6-88f006452ae3): created successfully Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cded2caa-a7d1-4043-9492-979eeabc954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:31:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Flow 'volume_create_manager' (eebdf7c7-91e4-42a8-92f1-f701321c32c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:31:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3db8b503-1a07-405d-a103-90a1145cf4f2 tempest-AttachVolumeTestJSON-860812365 None] Created volume successfully. Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[87859c20-7bdb-4105-b89e-451d68775e23]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:31:54 devstack quobyte-client[84349]: System call of process 96283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3" returned: 0 in 0.506s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:31:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.573s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:31:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6a5de4bf-6f1e-448b-bf5e-254849d8f0cd req-b77c2552-1954-4417-9c62-fd855013ac98 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-6a5de4bf-6f1e-448b-bf5e-254849d8f0cd req-b77c2552-1954-4417-9c62-fd855013ac98 tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:55 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-6a5de4bf-6f1e-448b-bf5e-254849d8f0cd req-b77c2552-1954-4417-9c62-fd855013ac98 tempest-TestInstancesWithCinderVolumes-1677631332 None] Terminate volume connection completed successfully. Sep 25 21:31:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-6a5de4bf-6f1e-448b-bf5e-254849d8f0cd req-b77c2552-1954-4417-9c62-fd855013ac98 tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleting attachment 383ad436-d252-40af-9cb2-a45d88d4db94. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:31:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-67023825-1d35-4c07-9ec6-88f006452ae3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcf414f0-9b0c-4be6-8c21-3039073d37e9', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:31:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:55 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-85c80077-b7f2-472e-a70f-80e00d6d6ad2 req-dd5eb09b-93d8-4bc7-9c34-ae6a5da92387 tempest-AttachVolumeTestJSON-860812365 None] attachment_update completed successfully. Sep 25 21:31:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-2b83a4ec-f9ee-4c87-852a-6cf773a24708-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-2b83a4ec-f9ee-4c87-852a-6cf773a24708-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:31:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "cinder-quobyte-2b83a4ec-f9ee-4c87-852a-6cf773a24708" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:31:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-2b83a4ec-f9ee-4c87-852a-6cf773a24708" acquired by "delete_volume" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:31:59 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2571b-59f3-456a-b2f7-f698f2e20401]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:31:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:00 devstack quobyte-client[84349]: System call of process 96296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 0.842s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 1 in 0.669s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:32:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2b83a4ec-f9ee-4c87-852a-6cf773a24708" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-quobyte-2b83a4ec-f9ee-4c87-852a-6cf773a24708" released by "delete_volume" :: held 2.010s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:01 devstack cinder-volume[84334]: WARNING cinder.quota [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744197023-919933661 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744197023-919933661, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:32:01 devstack cinder-volume[84334]: WARNING cinder.quota [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744197023-919933661 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744197023-919933661, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Created reservations ['65ac3e22-7748-4cb2-850b-fef71c2b6079', 'ad8027aa-efe8-4fdb-a82f-2045bdea6116', 'e6f9b890-3d3c-4fc8-a5f7-993610ebe3d6', 'd85af15d-0201-491e-9840-b6d413366ab9'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.140s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:01 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Deleted volume successfully. Sep 25 21:32:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-30697d3c-5542-40e8-8018-e8ac431934db tempest-TestInstancesWithCinderVolumes-1677631332 None] Lock "cinder-2b83a4ec-f9ee-4c87-852a-6cf773a24708-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:11 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=25,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:32:12 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:32:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:22 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (49ed2a51-2fe3-40fa-8a64-2ee48b9e1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc43ac-b8bb-4f43-8ebd-230f5e4e7f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc43ac-b8bb-4f43-8ebd-230f5e4e7f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803326345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20796be9-a873-4637-802c-0a019430690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:23Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87d737a-ced2-4106-9838-ada6178b047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87d737a-ced2-4106-9838-ada6178b047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99810771-eb6b-4832-a5fa-f594b2a2d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99810771-eb6b-4832-a5fa-f594b2a2d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20796be9-a873-4637-802c-0a019430690d', 'volume_name': 'volume-20796be9-a873-4637-802c-0a019430690d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f225bca-df68-4685-b6a3-d23b4f28a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f225bca-df68-4685-b6a3-d23b4f28a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243bdb27-4e1e-4ce2-be65-d7b0f609d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:23 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Volume 20796be9-a873-4637-802c-0a019430690d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20796be9-a873-4637-802c-0a019430690d', 'volume_size': 1} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803326345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20796be9-a873-4637-802c-0a019430690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:23Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Creating volume 20796be9-a873-4637-802c-0a019430690d {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:23 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:23 devstack quobyte-client[84349]: System call of process 96479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:23 devstack quobyte-client[84349]: System call of process 96479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:23 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=65, name=volume-20796be9-a873-4637-802c-0a019430690d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (1f6aebe0-c2c6-4be6-8372-55bd2c955e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622d52a0-0416-413e-887b-d7ffe049a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622d52a0-0416-413e-887b-d7ffe049a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507882000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91380e3-2b9f-4cce-a21f-1b7498ee7635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:23Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a81000-f067-4f76-83b7-427d9b094962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a81000-f067-4f76-83b7-427d9b094962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f21ff9-1eb8-4df7-86e9-b38532b368cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f21ff9-1eb8-4df7-86e9-b38532b368cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91380e3-2b9f-4cce-a21f-1b7498ee7635', 'volume_name': 'volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f82bf-f4c5-4caa-b50c-6d1158604f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f82bf-f4c5-4caa-b50c-6d1158604f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c5b8b1-638a-4f88-ae04-a1d6e7fc382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:24 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Volume a91380e3-2b9f-4cce-a21f-1b7498ee7635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635', 'volume_size': 1} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d 1073741824" returned: 0 in 1.266s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:24 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:24 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (7652a914-6257-47e3-a68f-f50375f97f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc244cea-087d-4c83-8364-efecbdafee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc244cea-087d-4c83-8364-efecbdafee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138573700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa917e2e-d0c8-48b7-aa5d-dec237d17b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:24Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6175be8b-17d7-4a6d-ac05-ef43c9a606d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6175be8b-17d7-4a6d-ac05-ef43c9a606d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28172cfe-2f90-4eef-98cd-d19e5a17090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28172cfe-2f90-4eef-98cd-d19e5a17090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa917e2e-d0c8-48b7-aa5d-dec237d17b79', 'volume_name': 'volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218e1a74-4217-4adc-af4a-7e4d6f91cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218e1a74-4217-4adc-af4a-7e4d6f91cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc69c1b-5045-4c0b-b052-4c47b22f6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:25 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Volume fa917e2e-d0c8-48b7-aa5d-dec237d17b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79', 'volume_size': 1} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d" returned: 0 in 0.810s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] <== create_volume: return (2173ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507882000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91380e3-2b9f-4cce-a21f-1b7498ee7635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:23Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Creating volume a91380e3-2b9f-4cce-a21f-1b7498ee7635 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:25 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:25 devstack quobyte-client[84349]: System call of process 96484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:25 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=66, name=volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243bdb27-4e1e-4ce2-be65-d7b0f609d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20796be9-a873-4637-802c-0a019430690d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8066133-ce36-4178-90be-12df6db593d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d575d958-52ca-40e8-9744-6311da6c8362 req-06a6fa26-ae3a-46e4-9283-d81bf4202185 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (6d2bd174-1b3b-43a4-b314-f08f660f781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e32420b-1e75-4392-a743-99f64252cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Volume volume-20796be9-a873-4637-802c-0a019430690d (20796be9-a873-4637-802c-0a019430690d): created successfully Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8066133-ce36-4178-90be-12df6db593d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (49ed2a51-2fe3-40fa-8a64-2ee48b9e1148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (6bed2726-8f9c-4229-bf7d-4e867b1810e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbc695f-a5cc-4489-ac59-348e09e6aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbc695f-a5cc-4489-ac59-348e09e6aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384845641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de6977e-c4d5-454f-ac1e-e5276ee168a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:26Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8288432-d822-4c56-864c-867487c4e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8288432-d822-4c56-864c-867487c4e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf52ce2-492d-4043-85fc-b213ff5e977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf52ce2-492d-4043-85fc-b213ff5e977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de6977e-c4d5-454f-ac1e-e5276ee168a3', 'volume_name': 'volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74939043-5407-45c1-87c0-a568602442f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74939043-5407-45c1-87c0-a568602442f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c488cb15-a901-48f6-ad46-4fc78edc9293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Volume 6de6977e-c4d5-454f-ac1e-e5276ee168a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3', 'volume_size': 1} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-df4539df-e217-4097-ab1f-62caf7d968ce tempest-CreateVolumesFromImageTest-1485330036 None] Created volume successfully. Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e32420b-1e75-4392-a743-99f64252cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-44572930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5f9abe-4d73-4678-9de3-21e73a2b7df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:25Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeacf482-be64-4de0-9a25-8426d0720e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeacf482-be64-4de0-9a25-8426d0720e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c3a01e-3d0e-4e93-a8b8-9ec22d3ad4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c3a01e-3d0e-4e93-a8b8-9ec22d3ad4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5f9abe-4d73-4678-9de3-21e73a2b7df3', 'volume_name': 'volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b71b83c-4a27-4504-b0af-057a6a893462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b71b83c-4a27-4504-b0af-057a6a893462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c841205-23f3-41ce-854c-4f6db96ee300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Volume 8e5f9abe-4d73-4678-9de3-21e73a2b7df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3', 'volume_size': 1} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 1073741824" returned: 0 in 0.873s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d575d958-52ca-40e8-9744-6311da6c8362 req-06a6fa26-ae3a-46e4-9283-d81bf4202185 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-d575d958-52ca-40e8-9744-6311da6c8362 req-06a6fa26-ae3a-46e4-9283-d81bf4202185 tempest-AttachVolumeTestJSON-860812365 None] Terminate volume connection completed successfully. Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-d575d958-52ca-40e8-9744-6311da6c8362 req-06a6fa26-ae3a-46e4-9283-d81bf4202185 tempest-AttachVolumeTestJSON-860812365 None] Deleting attachment 7709acd0-fd08-4ae9-bc08-b4476700d5cb. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635" returned: 0 in 0.370s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] <== create_volume: return (1300ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138573700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa917e2e-d0c8-48b7-aa5d-dec237d17b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:24Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Creating volume fa917e2e-d0c8-48b7-aa5d-dec237d17b79 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:26 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:27 devstack quobyte-client[84349]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:27 devstack quobyte-client[84349]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:27 devstack quobyte-client[84349]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:27 devstack quobyte-client[84349]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:27 devstack quobyte-client[84349]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:27 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=67, name=volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c5b8b1-638a-4f88-ae04-a1d6e7fc382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fb6aae-c555-4e2d-927b-2ec7b5df529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 1073741824" returned: 0 in 0.543s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:27 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Volume volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 (a91380e3-2b9f-4cce-a21f-1b7498ee7635): created successfully Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fb6aae-c555-4e2d-927b-2ec7b5df529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (1f6aebe0-c2c6-4be6-8372-55bd2c955e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" returned: 0 in 0.377s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] <== create_volume: return (951ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384845641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de6977e-c4d5-454f-ac1e-e5276ee168a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:26Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Creating volume 6de6977e-c4d5-454f-ac1e-e5276ee168a3 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:27 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:28 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cd9da7f2-8d16-4004-add9-b3fd2638231a tempest-CreateVolumesFromImageTest-1485330036 None] Created volume successfully. Sep 25 21:32:28 devstack quobyte-client[84349]: System call of process 96507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:28 devstack quobyte-client[84349]: System call of process 96507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:28 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=68, name=volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc69c1b-5045-4c0b-b052-4c47b22f6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc0dc8-d524-409b-9e5a-351034bc8e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:28 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Volume volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 (fa917e2e-d0c8-48b7-aa5d-dec237d17b79): created successfully Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc0dc8-d524-409b-9e5a-351034bc8e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (7652a914-6257-47e3-a68f-f50375f97f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 1073741824" returned: 0 in 0.801s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0fb286ca-d73c-45df-94b2-108f059cf233 tempest-CreateVolumesFromImageTest-1485330036 None] Created volume successfully. Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3" returned: 0 in 0.416s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] <== create_volume: return (1309ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-44572930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5f9abe-4d73-4678-9de3-21e73a2b7df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae15161633e404d9a968aec7236994d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:25Z,use_quota=True,user_id='47e931f30f404551980f54e6140a0609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Creating volume 8e5f9abe-4d73-4678-9de3-21e73a2b7df3 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:29 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:29 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=69, name=volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c488cb15-a901-48f6-ad46-4fc78edc9293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0944875c-fb97-49df-895a-e2f8c746a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:29 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Volume volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 (6de6977e-c4d5-454f-ac1e-e5276ee168a3): created successfully Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0944875c-fb97-49df-895a-e2f8c746a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:29 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (6bed2726-8f9c-4229-bf7d-4e867b1810e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 1073741824" returned: 0 in 0.714s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fbbac012-7f3b-4143-b14a-de3c3c7226ba tempest-CreateVolumesFromImageTest-1485330036 None] Created volume successfully. Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" returned: 0 in 0.284s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] <== create_volume: return (1033ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c841205-23f3-41ce-854c-4f6db96ee300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482759-e882-4392-a313-f8007c87e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:30 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Volume volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 (8e5f9abe-4d73-4678-9de3-21e73a2b7df3): created successfully Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482759-e882-4392-a313-f8007c87e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Flow 'volume_create_manager' (6d2bd174-1b3b-43a4-b314-f08f660f781b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f40c2c60-2ece-4bef-8bab-f2789522ac23 tempest-CreateVolumesFromImageTest-1485330036 None] Created volume successfully. Sep 25 21:32:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-6de6977e-c4d5-454f-ac1e-e5276ee168a3-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-6de6977e-c4d5-454f-ac1e-e5276ee168a3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-quobyte-6de6977e-c4d5-454f-ac1e-e5276ee168a3" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-6de6977e-c4d5-454f-ac1e-e5276ee168a3" acquired by "delete_volume" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa38962-c516-4f60-acc0-6e7a6028ba0c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:31 devstack quobyte-client[84349]: System call of process 96518 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:31 devstack quobyte-client[84349]: System call of process 96518 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3" returned: 0 in 0.590s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-6de6977e-c4d5-454f-ac1e-e5276ee168a3" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-6de6977e-c4d5-454f-ac1e-e5276ee168a3" released by "delete_volume" :: held 0.959s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Created reservations ['6119785d-8245-4287-94ba-44e70422d204', 'db05d2fd-ce0e-4810-bd0c-9ca5593d5099', '6bce7da5-af87-4a25-b544-97d6e846ee1b', '39ba8a8a-0ac3-469e-8f0f-c8beec90426a'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.125s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:32 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Deleted volume successfully. Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-187d7c7e-449a-4ff2-9172-4a9bffe928c8 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-6de6977e-c4d5-454f-ac1e-e5276ee168a3-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-8e5f9abe-4d73-4678-9de3-21e73a2b7df3-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-8e5f9abe-4d73-4678-9de3-21e73a2b7df3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:33 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-quobyte-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dba7b4-a1c2-47a8-b6ac-3f5609e48feb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:34 devstack quobyte-client[84349]: System call of process 96527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:34 devstack quobyte-client[84349]: System call of process 96527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:34 devstack quobyte-client[84349]: System call of process 96527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:34 devstack quobyte-client[84349]: System call of process 96527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" returned: 0 in 0.473s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" returned: 0 in 0.090s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-8e5f9abe-4d73-4678-9de3-21e73a2b7df3" released by "delete_volume" :: held 0.726s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Created reservations ['6270b9da-56f8-4cf4-af83-a542f052fa07', '30b81271-3048-4e66-ba32-a2b87aa7b1a3', '1be95130-ae41-4728-ad4c-4f3906ea5bef', 'b8403552-7831-4fa2-b62c-2a13284af0f5'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:34 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Deleted volume successfully. Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4ace9a33-0410-496f-bcdb-470ca471a4d7 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-8e5f9abe-4d73-4678-9de3-21e73a2b7df3-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-fa917e2e-d0c8-48b7-aa5d-dec237d17b79-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-fa917e2e-d0c8-48b7-aa5d-dec237d17b79-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:35 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-quobyte-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a39fe5-03cb-495f-94d1-f72afbc2b74d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" returned: 0 in 0.497s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" returned: 0 in 0.128s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-fa917e2e-d0c8-48b7-aa5d-dec237d17b79" released by "delete_volume" :: held 0.785s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Created reservations ['b2b289fc-0cf0-42ce-b5f9-44fced0f6eb9', 'd83f6721-5d7c-40b1-845a-f2404ac65a96', '8ac509a6-5371-4be6-b49e-f952e7b0374c', '608573f5-6c54-459f-b684-bf596065cc4b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:37 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Deleted volume successfully. Sep 25 21:32:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-dd7c0e8e-c719-4355-906b-1ef2b5ec81e0 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-fa917e2e-d0c8-48b7-aa5d-dec237d17b79-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-a91380e3-2b9f-4cce-a21f-1b7498ee7635-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-a91380e3-2b9f-4cce-a21f-1b7498ee7635-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-quobyte-a91380e3-2b9f-4cce-a21f-1b7498ee7635" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-a91380e3-2b9f-4cce-a21f-1b7498ee7635" acquired by "delete_volume" :: waited 0.016s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[587dda63-7829-4646-8157-64305639ab6f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635" returned: 0 in 0.441s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a91380e3-2b9f-4cce-a21f-1b7498ee7635" returned: 0 in 0.112s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-a91380e3-2b9f-4cce-a21f-1b7498ee7635" released by "delete_volume" :: held 0.703s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Created reservations ['3ae355d2-1cc1-4754-86fa-bd37230d91d3', 'e98f8af6-bc1e-4410-9f93-df1667e0716d', '87709d72-fd97-4f5a-bacc-1a0411bdfa8b', 'ee788d4a-a2aa-4765-8a73-07beb696f2c0'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Deleted volume successfully. Sep 25 21:32:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0f04c5a0-36c9-46ce-b039-da5fb859e354 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-a91380e3-2b9f-4cce-a21f-1b7498ee7635-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-20796be9-a873-4637-802c-0a019430690d-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-20796be9-a873-4637-802c-0a019430690d-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "cinder-quobyte-20796be9-a873-4637-802c-0a019430690d" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-20796be9-a873-4637-802c-0a019430690d" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d63a37f-ead9-444b-b8c5-37890af028d8]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:41 devstack quobyte-client[84349]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:41 devstack quobyte-client[84349]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:41 devstack quobyte-client[84349]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:41 devstack quobyte-client[84349]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d" returned: 0 in 0.431s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20796be9-a873-4637-802c-0a019430690d" returned: 0 in 0.118s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-quobyte-20796be9-a873-4637-802c-0a019430690d" released by "delete_volume" :: held 0.758s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Created reservations ['06315a74-a8bf-4a25-842c-dca0f9a4009d', '6a5f296c-8032-4619-809a-ce241dcf589f', 'ecdb0ea1-2756-4771-befa-a8665da04c77', '2675edec-c83e-4b90-99be-d0cded4b53a9'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.092s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:32:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Deleted volume successfully. Sep 25 21:32:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-00e114f7-8e19-4386-9875-64f43fc034b3 tempest-CreateVolumesFromImageTest-1485330036 None] Lock "cinder-20796be9-a873-4637-802c-0a019430690d-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:32:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (cae9f21d-4ecc-4094-8e7d-3471fea832aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b52c46-b9d5-4aff-af77-070b7c34a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b52c46-b9d5-4aff-af77-070b7c34a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548473946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5531b25e-b06d-4077-b0f4-906be04702a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:46Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a571bfe-3bde-48f8-b84c-4e551f165b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a571bfe-3bde-48f8-b84c-4e551f165b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30e8300-9d09-45e0-b114-13819820a480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30e8300-9d09-45e0-b114-13819820a480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5531b25e-b06d-4077-b0f4-906be04702a4', 'volume_name': 'volume-5531b25e-b06d-4077-b0f4-906be04702a4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d634d40-0ae3-47fd-982b-5ec2e2f8a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d634d40-0ae3-47fd-982b-5ec2e2f8a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c6c9d0-1e45-4bd1-a248-c9e3ac888417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume 5531b25e-b06d-4077-b0f4-906be04702a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5531b25e-b06d-4077-b0f4-906be04702a4', 'volume_size': 1} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548473946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5531b25e-b06d-4077-b0f4-906be04702a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:46Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume 5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:46 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:46 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=70, name=volume-5531b25e-b06d-4077-b0f4-906be04702a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 1073741824" returned: 0 in 0.338s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (502ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c6c9d0-1e45-4bd1-a248-c9e3ac888417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5531b25e-b06d-4077-b0f4-906be04702a4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238e7a8f-1d64-4104-9ac6-21ae0e26cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:47 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-5531b25e-b06d-4077-b0f4-906be04702a4 (5531b25e-b06d-4077-b0f4-906be04702a4): created successfully Sep 25 21:32:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238e7a8f-1d64-4104-9ac6-21ae0e26cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (cae9f21d-4ecc-4094-8e7d-3471fea832aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ea5743e2-2921-467f-9e21-2ce2945db71a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:32:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating offline snapshot a37175ab-0b84-412e-b416-720bd6675132 of volume 5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:32:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2110370c-0f32-4c97-9240-96ba6677ef27]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:32:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:49 devstack quobyte-client[84349]: System call of process 96563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:49 devstack quobyte-client[84349]: System call of process 96563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4" returned: 0 in 0.464s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:49 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=71, name=volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 1G" returned: 0 in 0.315s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5531b25e-b06d-4077-b0f4-906be04702a4 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img rebase -u -b volume-5531b25e-b06d-4077-b0f4-906be04702a4 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 0.138s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:32:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 0.089s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.info" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.info" returned: 0 in 0.094s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.725s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e9d7550c-7b61-4bba-a418-d41b82550fce tempest-CreateVolumesFromSnapshotTest-1748730767 None] Create snapshot completed successfully Sep 25 21:32:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-c5cc89ee-4346-41af-9350-b7dc4ce6c197 req-8d890d13-a3c6-4fe7-86dd-ef39990efc82 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-c5cc89ee-4346-41af-9350-b7dc4ce6c197 req-8d890d13-a3c6-4fe7-86dd-ef39990efc82 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:52 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-c5cc89ee-4346-41af-9350-b7dc4ce6c197 req-8d890d13-a3c6-4fe7-86dd-ef39990efc82 tempest-AttachVolumeTestJSON-860812365 None] Terminate volume connection completed successfully. Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-c5cc89ee-4346-41af-9350-b7dc4ce6c197 req-8d890d13-a3c6-4fe7-86dd-ef39990efc82 tempest-AttachVolumeTestJSON-860812365 None] Deleting attachment bcf414f0-9b0c-4be6-8c21-3039073d37e9. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:32:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (c78f52b4-0e8b-43d0-af48-f44390a040fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b4e4cd-9a9c-4e77-91ae-c2d5b57ebb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b4e4cd-9a9c-4e77-91ae-c2d5b57ebb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795229197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64161aac-f340-49a9-bf2d-eaa4a471b9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:52Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea0ace4-a55b-4ec0-9afc-5dbc9583a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea0ace4-a55b-4ec0-9afc-5dbc9583a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f824a65-759d-401e-b7f4-0d4f79004295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f824a65-759d-401e-b7f4-0d4f79004295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64161aac-f340-49a9-bf2d-eaa4a471b9e4', 'volume_name': 'volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e627af-00da-4408-a362-2ba391e7d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e627af-00da-4408-a362-2ba391e7d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ee30e1-37c4-4195-aebe-961eddd086ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume 64161aac-f340-49a9-bf2d-eaa4a471b9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4', 'volume_size': 1} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795229197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64161aac-f340-49a9-bf2d-eaa4a471b9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:52Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume 64161aac-f340-49a9-bf2d-eaa4a471b9e4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:52 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:52 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=73, name=volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 1073741824" returned: 0 in 0.716s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:53 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (0997c6d3-bc83-428c-93a6-778e261c9aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ecb7b9-5a8b-4063-bd7a-9aa43c2974ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4" returned: 0 in 0.590s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ecb7b9-5a8b-4063-bd7a-9aa43c2974ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853133768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b1af63-edb1-4ac6-8d2a-13f35fce8b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:53Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d68acee-01cc-49db-b342-c50784e9fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d68acee-01cc-49db-b342-c50784e9fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5664f11e-0df0-45a8-a962-c58cc9e03281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5664f11e-0df0-45a8-a962-c58cc9e03281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b1af63-edb1-4ac6-8d2a-13f35fce8b34', 'volume_name': 'volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb83fee-aec0-4e73-af24-07d41dfea176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb83fee-aec0-4e73-af24-07d41dfea176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2c7e5a-fea9-4be7-9ce5-7aac1cb75403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:53 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume 08b1af63-edb1-4ac6-8d2a-13f35fce8b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34', 'volume_size': 1} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (1421ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853133768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b1af63-edb1-4ac6-8d2a-13f35fce8b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:53Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume 08b1af63-edb1-4ac6-8d2a-13f35fce8b34 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:54 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:54 devstack quobyte-client[84349]: System call of process 96582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:54 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=74, name=volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ee30e1-37c4-4195-aebe-961eddd086ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37db5ee9-4d0f-4ab6-9acd-0c4973f3508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (f9bbccf7-16d8-4f8c-8f5d-28fd5e0a3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bd4efc-3a96-4510-ab3d-0f545f1eaa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (1c4b9337-f79e-4937-b62a-50fdf2a0a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff960ef1-a2d1-400d-8a4d-7b38e778d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff960ef1-a2d1-400d-8a4d-7b38e778d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949053230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a271c-c8ea-4c6e-883a-988de2312fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:54Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceddc59-d988-4815-8179-91f85209a23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceddc59-d988-4815-8179-91f85209a23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0c0daf-6d3e-493f-966d-4b1d58d511cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0c0daf-6d3e-493f-966d-4b1d58d511cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2a271c-c8ea-4c6e-883a-988de2312fb4', 'volume_name': 'volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d1d330-e945-4a27-853d-8ae80f5379ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d1d330-e945-4a27-853d-8ae80f5379ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4590772d-8f04-48d5-a57d-3b8e2a159805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume 3a2a271c-c8ea-4c6e-883a-988de2312fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4', 'volume_size': 1} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (de12af4c-b268-4a1a-824f-b617311e6bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68fa1e3-6353-47a2-a4f2-fda715c6c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 (64161aac-f340-49a9-bf2d-eaa4a471b9e4): created successfully Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37db5ee9-4d0f-4ab6-9acd-0c4973f3508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (c78f52b4-0e8b-43d0-af48-f44390a040fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68fa1e3-6353-47a2-a4f2-fda715c6c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823548837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c46855-d56a-45d8-afc3-2a7b013c8572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:54Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090b9de3-3405-4d53-b6f0-28663c8b728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090b9de3-3405-4d53-b6f0-28663c8b728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe43c5b-5382-4a00-a379-41fbc2755dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe43c5b-5382-4a00-a379-41fbc2755dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c46855-d56a-45d8-afc3-2a7b013c8572', 'volume_name': 'volume-98c46855-d56a-45d8-afc3-2a7b013c8572', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afe8e33-5c7d-435b-86aa-85bb3d18f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afe8e33-5c7d-435b-86aa-85bb3d18f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d809b-9ac2-4c3a-9b92-b42b534b66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume 98c46855-d56a-45d8-afc3-2a7b013c8572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c46855-d56a-45d8-afc3-2a7b013c8572', 'volume_size': 1} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 1073741824" returned: 0 in 0.947s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bd4efc-3a96-4510-ab3d-0f545f1eaa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903650417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e6bcdc-29b3-4a7b-930f-6238022eb0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:53Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f8179c-8353-41dc-afa8-38b6a4e95f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f8179c-8353-41dc-afa8-38b6a4e95f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a1c8b0-c4cf-41b9-bb72-954f28441c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a1c8b0-c4cf-41b9-bb72-954f28441c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e6bcdc-29b3-4a7b-930f-6238022eb0e2', 'volume_name': 'volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7417080-40b9-4465-8baf-19e9951e13a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7417080-40b9-4465-8baf-19e9951e13a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58518067-9770-4834-b49a-f99eecf16a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:55 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume e0e6bcdc-29b3-4a7b-930f-6238022eb0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2', 'volume_size': 1} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:55 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-20d822bd-7089-4c31-922c-6b7e014ef97a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" returned: 0 in 0.342s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (1358ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949053230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a271c-c8ea-4c6e-883a-988de2312fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:54Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume 3a2a271c-c8ea-4c6e-883a-988de2312fb4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:55 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:55 devstack quobyte-client[84349]: System call of process 96586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:55 devstack quobyte-client[84349]: System call of process 96586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:55 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=75, name=volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2c7e5a-fea9-4be7-9ce5-7aac1cb75403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28524bb-63f5-44d3-a273-89220e3362c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:55 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 (08b1af63-edb1-4ac6-8d2a-13f35fce8b34): created successfully Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28524bb-63f5-44d3-a273-89220e3362c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (0997c6d3-bc83-428c-93a6-778e261c9aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 1073741824" returned: 0 in 0.482s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5ade999d-a945-462f-8b92-a5d8490172d6 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4" returned: 0 in 0.405s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823548837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c46855-d56a-45d8-afc3-2a7b013c8572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:54Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume 98c46855-d56a-45d8-afc3-2a7b013c8572 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.148s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:56 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:57 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=76, name=volume-98c46855-d56a-45d8-afc3-2a7b013c8572, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4590772d-8f04-48d5-a57d-3b8e2a159805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b60468-071d-4c2b-8522-2ac0ad71d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 (3a2a271c-c8ea-4c6e-883a-988de2312fb4): created successfully Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b60468-071d-4c2b-8522-2ac0ad71d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (1c4b9337-f79e-4937-b62a-50fdf2a0a763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572 1073741824" returned: 0 in 1.065s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5564ce30-c587-4a27-98a9-53c3a4f82a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572" returned: 0 in 0.364s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (1615ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.190s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903650417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e6bcdc-29b3-4a7b-930f-6238022eb0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb1c34a9b94f1e8d3ee29c2374ca33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:32:53Z,use_quota=True,user_id='62ca22461dc64e1f9d7cd4dd127ac850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Creating volume e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:32:58 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:58 devstack quobyte-client[84349]: System call of process 96634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:58 devstack quobyte-client[84349]: System call of process 96634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:32:58 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=77, name=volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d809b-9ac2-4c3a-9b92-b42b534b66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c46855-d56a-45d8-afc3-2a7b013c8572', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcdf18f-93b7-4b98-a3a9-d87837aa8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:58 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-98c46855-d56a-45d8-afc3-2a7b013c8572 (98c46855-d56a-45d8-afc3-2a7b013c8572): created successfully Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcdf18f-93b7-4b98-a3a9-d87837aa8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (de12af4c-b268-4a1a-824f-b617311e6bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 1073741824" returned: 0 in 0.677s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:32:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0bb39a6f-b441-4d01-abd5-ef4d23c1743e tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" returned: 0 in 0.537s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] <== create_volume: return (1334ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58518067-9770-4834-b49a-f99eecf16a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6e837f-150e-48ea-a3ed-d55b5c5226b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:32:59 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 (e0e6bcdc-29b3-4a7b-930f-6238022eb0e2): created successfully Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6e837f-150e-48ea-a3ed-d55b5c5226b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:32:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Flow 'volume_create_manager' (f9bbccf7-16d8-4f8c-8f5d-28fd5e0a3819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:32:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-61a9b17d-bf0e-4b23-b90e-cf82115c4d43 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created volume successfully. Sep 25 21:33:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-3a2a271c-c8ea-4c6e-883a-988de2312fb4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-3a2a271c-c8ea-4c6e-883a-988de2312fb4-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-3a2a271c-c8ea-4c6e-883a-988de2312fb4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-3a2a271c-c8ea-4c6e-883a-988de2312fb4" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ba7d2a-4863-4451-9d4b-1b1cb76daeab]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:01 devstack quobyte-client[84349]: System call of process 96639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:01 devstack quobyte-client[84349]: System call of process 96639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4" returned: 0 in 0.658s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3a2a271c-c8ea-4c6e-883a-988de2312fb4" returned: 0 in 0.195s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-3a2a271c-c8ea-4c6e-883a-988de2312fb4" released by "delete_volume" :: held 1.197s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['8f3b5f8c-0ba0-44b3-8ed5-c2109b6a6182', '6ecee05c-06c8-4884-bc07-8d5b343d00c4', '7385a265-c625-4854-9b2a-01fdab4a64dd', '7674dfbf-d4ea-453d-96af-339bebab3b14'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.126s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-98c46855-d56a-45d8-afc3-2a7b013c8572-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-786aa9a9-8c0b-4794-8b88-0fd1fae9b430 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-3a2a271c-c8ea-4c6e-883a-988de2312fb4-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-98c46855-d56a-45d8-afc3-2a7b013c8572-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:03 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-98c46855-d56a-45d8-afc3-2a7b013c8572" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-98c46855-d56a-45d8-afc3-2a7b013c8572" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0fd6e-825f-4ad1-8bcb-e2e5c6702a1d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572" returned: 0 in 0.516s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98c46855-d56a-45d8-afc3-2a7b013c8572" returned: 0 in 0.145s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-98c46855-d56a-45d8-afc3-2a7b013c8572" released by "delete_volume" :: held 0.903s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['7d417524-d70c-420a-a43e-38842e11add8', '232dec4c-b19c-42fb-bc3c-cb39d045b902', 'ac70cffe-b403-44f4-885f-0a9033dcce35', 'b9a432b2-0e89-411b-ac31-c6e695e665b8'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.130s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-21762aa6-2305-4670-9f55-a835f303684a tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-98c46855-d56a-45d8-afc3-2a7b013c8572-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" acquired by "delete_volume" :: waited 0.022s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab270b2b-f54c-40e1-940c-96d7bb6c9675]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" returned: 0 in 0.485s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" returned: 0 in 0.096s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2" released by "delete_volume" :: held 0.752s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['b96edb99-7b15-4269-8eec-8c3bfe7f5eb6', 'fdcb22d7-a425-4df9-8f16-c2ff0ad7704d', '778c6616-ef44-4723-9602-046253e02ed1', 'cfcbe7b0-8c99-4f05-bed3-6ed0d96297c4'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.141s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:07 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c07b1a73-b9c8-459a-849b-e3f7299500b8 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-e0e6bcdc-29b3-4a7b-930f-6238022eb0e2-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-08b1af63-edb1-4ac6-8d2a-13f35fce8b34-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-08b1af63-edb1-4ac6-8d2a-13f35fce8b34-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" acquired by "delete_volume" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0f9b4-396c-479f-a35b-044e3fa76db4]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-67023825-1d35-4c07-9ec6-88f006452ae3-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:09 devstack quobyte-client[84349]: System call of process 96673 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:09 devstack quobyte-client[84349]: System call of process 96673 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:09 devstack quobyte-client[84349]: System call of process 96673 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" returned: 0 in 0.735s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-67023825-1d35-4c07-9ec6-88f006452ae3-delete_volume" acquired by "delete_volume" :: waited 0.263s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" returned: 0 in 0.337s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-08b1af63-edb1-4ac6-8d2a-13f35fce8b34" released by "delete_volume" :: held 1.173s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-quobyte-67023825-1d35-4c07-9ec6-88f006452ae3" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-67023825-1d35-4c07-9ec6-88f006452ae3" acquired by "delete_volume" :: waited 0.030s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b92b73-ebc2-418f-8215-2ee5fe3f4872]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['c150c3cb-f32f-4b6a-b1f0-f01858f82e61', '00460368-7917-4598-a294-858056d54a9a', '3177816b-0f7a-49c4-9e1a-20ef47d53547', '81eb72be-b9fa-41bc-95c3-56bfcc274204'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:10 devstack quobyte-client[84349]: System call of process 96678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:10 devstack quobyte-client[84349]: System call of process 96678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:10 devstack quobyte-client[84349]: System call of process 96678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:10 devstack quobyte-client[84349]: System call of process 96678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-64161aac-f340-49a9-bf2d-eaa4a471b9e4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-64161aac-f340-49a9-bf2d-eaa4a471b9e4-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 1.062s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3" returned: 0 in 1.929s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:11 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67023825-1d35-4c07-9ec6-88f006452ae3" returned: 0 in 0.409s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-67023825-1d35-4c07-9ec6-88f006452ae3" released by "delete_volume" :: held 2.515s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-64161aac-f340-49a9-bf2d-eaa4a471b9e4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-04d7ac74-5957-44f3-a68e-66cd11236a20 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-08b1af63-edb1-4ac6-8d2a-13f35fce8b34-delete_volume" released by "delete_volume" :: held 4.082s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-64161aac-f340-49a9-bf2d-eaa4a471b9e4" acquired by "delete_volume" :: waited 0.072s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d8c4e-90f7-40c8-9385-058d95d1dba6]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Created reservations ['4e9ce59b-29a8-474e-ac32-b3831a1bfde7', '38a14c6a-b555-4c02-aa4a-498de4255991', '4a14c94f-1d7a-4ae4-a1d9-8c7c72791af3', 'e56024ea-877b-47c4-855a-27422b62016e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4" returned: 0 in 0.758s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.273s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Deleted volume successfully. Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-64161aac-f340-49a9-bf2d-eaa4a471b9e4" returned: 0 in 0.335s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-64161aac-f340-49a9-bf2d-eaa4a471b9e4" released by "delete_volume" :: held 1.276s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b81f6253-a4f2-483d-883a-12221b0a531c tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-67023825-1d35-4c07-9ec6-88f006452ae3-delete_volume" released by "delete_volume" :: held 4.417s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-0ada0f38-afe5-47a6-97fb-95370b14ef01-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-0ada0f38-afe5-47a6-97fb-95370b14ef01-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-quobyte-0ada0f38-afe5-47a6-97fb-95370b14ef01" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['7a3763c1-9708-4a0e-af88-335cb67c2c8c', 'b77ab734-8c26-4bac-a005-832189241932', '4e330730-5ed8-4c54-a41b-fac3ca15d799', '39448633-a56e-429e-a24d-721bf8aab7df'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-0ada0f38-afe5-47a6-97fb-95370b14ef01" acquired by "delete_volume" :: waited 0.039s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d880d57-322e-41db-92ac-af07052606cf]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-a37175ab-0b84-412e-b416-720bd6675132-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-a37175ab-0b84-412e-b416-720bd6675132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.437s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01" returned: 0 in 1.003s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.574s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" acquired by "delete_snapshot" :: waited 0.300s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-a37175ab-0b84-412e-b416-720bd6675132" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0ada0f38-afe5-47a6-97fb-95370b14ef01" returned: 0 in 0.447s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-0ada0f38-afe5-47a6-97fb-95370b14ef01" released by "delete_volume" :: held 1.548s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-a37175ab-0b84-412e-b416-720bd6675132" acquired by "_delete_snapshot" :: waited 0.235s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleting offline snapshot a37175ab-0b84-412e-b416-720bd6675132 of volume 5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] snapshot_file for this snap is: volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b3481d6e-a580-4ebd-b4b1-417d5655c3ec tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-64161aac-f340-49a9-bf2d-eaa4a471b9e4-delete_volume" released by "delete_volume" :: held 4.431s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37beed-70ae-40af-a735-9ac400de7dc9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Created reservations ['592f59e6-d512-4d3e-9b6d-d42eae61e8e0', 'e11843a5-9e83-4068-9959-0cf2659151ed', '61096aa6-1c0b-45f5-84c1-d9143acdb143', '4ac8d8c5-9f52-474f-b551-89aeea41781b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:16 devstack quobyte-client[84349]: System call of process 96726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:16 devstack quobyte-client[84349]: System call of process 96726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 0.683s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5531b25e-b06d-4077-b0f4-906be04702a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd02ddac-1d0e-4376-815d-26d6510494ec]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.200s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:17 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:17 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Deleted volume successfully. Sep 25 21:33:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4" returned: 0 in 1.733s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3096e2c3-133a-4e3b-bc40-5687bc9be8fb tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-0ada0f38-afe5-47a6-97fb-95370b14ef01-delete_volume" released by "delete_volume" :: held 4.668s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5-delete_volume" acquired by "delete_volume" :: waited 0.666s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 1.086s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "cinder-quobyte-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4.a37175ab-0b84-412e-b416-720bd6675132" returned: 0 in 1.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-a37175ab-0b84-412e-b416-720bd6675132" released by "_delete_snapshot" :: held 4.918s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" acquired by "delete_volume" :: waited 0.210s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadca588-a11d-4767-a98c-24cad0d45e39]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" released by "delete_snapshot" :: held 5.263s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:21 devstack quobyte-client[84349]: System call of process 96749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:21 devstack quobyte-client[84349]: System call of process 96749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" returned: 0 in 1.068s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:21 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['80614edb-0be1-4781-8506-0c31778c5950', '3f8ce8b6-b732-4db8-8389-8373b5a8deba', 'c3a27f63-adaf-4292-a699-21a06b2e24da', '4d2ec8d6-e17c-404a-b0d5-42f4239fa013'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=80,cinder:UPDATE=130,cinder:DELETE=10,cinder:INSERT=38 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:33:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=112,cinder:SELECT=77,cinder:DELETE=14,cinder:INSERT=14 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:33:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" returned: 0 in 0.848s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-quobyte-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5" released by "delete_volume" :: held 2.368s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:23 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Delete snapshot completed successfully. Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f3a2f1f0-739c-4ef8-b6f7-104dcd4f09f7 tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-a37175ab-0b84-412e-b416-720bd6675132-delete_snapshot" released by "delete_snapshot" :: held 8.230s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Created reservations ['e5a98742-01ae-4144-92f7-3b21e48c555e', 'e6915f89-84ca-4103-9541-3287ea9c17b9', '14e63a54-0c68-4f55-9be9-de0be0276eab', '044e33e6-e52e-4800-acda-48db7c8b8197'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-5531b25e-b06d-4077-b0f4-906be04702a4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-5531b25e-b06d-4077-b0f4-906be04702a4-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.365s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Deleted volume successfully. Sep 25 21:33:24 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9b8e8962-a1e6-4fe7-9c5e-3a3175599517 tempest-AttachVolumeTestJSON-860812365 None] Lock "cinder-87e01d7b-fd93-4a0e-b0af-bb65c30fa1a5-delete_volume" released by "delete_volume" :: held 5.695s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" acquired by "delete_volume" :: waited 0.061s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb79987b-9125-4355-ab37-50a39389f756]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:25 devstack quobyte-client[84349]: System call of process 96758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4" returned: 0 in 1.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-5531b25e-b06d-4077-b0f4-906be04702a4" returned: 0 in 0.232s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-quobyte-5531b25e-b06d-4077-b0f4-906be04702a4" released by "delete_volume" :: held 1.648s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Created reservations ['18555e0b-f2df-429c-9a9d-c481f6b9249b', '8bcf1d6a-0ded-4707-923e-4d58c89f5720', '2623d691-394d-4391-8b5a-4408e6e41197', '475b5649-6512-4f36-bf65-5ec728220dc7'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:26 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Deleted volume successfully. Sep 25 21:33:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a09e75de-2c23-4807-8654-07bec475530d tempest-CreateVolumesFromSnapshotTest-1748730767 None] Lock "cinder-5531b25e-b06d-4077-b0f4-906be04702a4-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:33 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Flow 'volume_create_manager' (4a158b54-bae7-436c-a062-c31a96be1b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f12a1b1-1949-4a6f-8f50-f8945f9126bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f12a1b1-1949-4a6f-8f50-f8945f9126bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0900eb0-f9ba-4463-8ad6-1b214f6e176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd251205ee545f290c91cd9d1025608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:34Z,use_quota=True,user_id='076743c6ead24606910ddb7d804dea70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8547636d-5c94-46cc-9e2b-176405d96421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8547636d-5c94-46cc-9e2b-176405d96421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ac7016-da3a-4886-a46f-25d392db40f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:33 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ac7016-da3a-4886-a46f-25d392db40f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0900eb0-f9ba-4463-8ad6-1b214f6e176e', 'volume_name': 'volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e', 'volume_size': 1, 'image_id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6d19b3fe03309329ec2d01ee7b8807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd251205ee545f290c91cd9d1025608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84290ecdd9973866741140d00b6033a4e8ba390797f3d79d7224a7a4f49451f31f2d5bfaadb5608718bcb3c61a881fd9ad2ffc41b5238d7d01112ac8106f515f', 'id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'created_at': datetime.datetime(2025, 9, 25, 19, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae67b119-b8c6-47fd-8074-747d07dd4c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae67b119-b8c6-47fd-8074-747d07dd4c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76f8174-e869-46c2-93a6-0a9914569609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:34 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e', 'volume_size': 1, 'image_id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6d19b3fe03309329ec2d01ee7b8807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd251205ee545f290c91cd9d1025608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84290ecdd9973866741140d00b6033a4e8ba390797f3d79d7224a7a4f49451f31f2d5bfaadb5608718bcb3c61a881fd9ad2ffc41b5238d7d01112ac8106f515f', 'id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'created_at': datetime.datetime(2025, 9, 25, 19, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606/file', 'properties': {}}, 'image_service': } Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Cloning a0900eb0-f9ba-4463-8ad6-1b214f6e176e from image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:33:34 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3474d4-26c7-4db3-8aba-8b5d91e72638]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:34 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD Sep 25 21:33:34 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:35 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Flow 'volume_create_manager' (a6718abb-b7b6-498f-9989-1054fe834051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9ea5c8-7bfb-4244-9c46-5ee0daa99e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9ea5c8-7bfb-4244-9c46-5ee0daa99e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-703423998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be259e9d-6649-49ba-9b73-ea399cdc5d3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b9a9da54b534116bc69896a048a4d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:35Z,use_quota=True,user_id='1014325ad3554dfeb7d169eb36e6184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ee830b-0662-401a-b766-6bb113fe0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ee830b-0662-401a-b766-6bb113fe0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fe608-9e51-4749-a95d-175619b993a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fe608-9e51-4749-a95d-175619b993a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be259e9d-6649-49ba-9b73-ea399cdc5d3c', 'volume_name': 'volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40519ffe-8069-4073-a096-3cb7cf4182bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40519ffe-8069-4073-a096-3cb7cf4182bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a7634-1031-4e22-9443-d4f3b570ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:35 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Volume be259e9d-6649-49ba-9b73-ea399cdc5d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c', 'volume_size': 1} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-703423998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be259e9d-6649-49ba-9b73-ea399cdc5d3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b9a9da54b534116bc69896a048a4d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:35Z,use_quota=True,user_id='1014325ad3554dfeb7d169eb36e6184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Creating volume be259e9d-6649-49ba-9b73-ea399cdc5d3c {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:33:35 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:33:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:35 devstack quobyte-client[84349]: System call of process 96775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:35 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=78, name=volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c 1073741824" returned: 0 in 0.405s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c" returned: 0 in 0.220s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a7634-1031-4e22-9443-d4f3b570ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3460ec42-3611-44d4-ad29-fdcc067b193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:36 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Volume volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c (be259e9d-6649-49ba-9b73-ea399cdc5d3c): created successfully Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3460ec42-3611-44d4-ad29-fdcc067b193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Flow 'volume_create_manager' (a6718abb-b7b6-498f-9989-1054fe834051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-ee7c1ace-fa27-412e-910b-dc9836ed9a93 req-37a4d672-5b83-4523-9477-4fe3c1fcf6b3 tempest-VolumesGetTestJSON-522133568 None] Created volume successfully. Sep 25 21:33:37 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 0 in 2.550s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:37 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD Sep 25 21:33:37 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Acquiring lock "cinder-be259e9d-6649-49ba-9b73-ea399cdc5d3c-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "cinder-be259e9d-6649-49ba-9b73-ea399cdc5d3c-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Acquiring lock "cinder-quobyte-be259e9d-6649-49ba-9b73-ea399cdc5d3c" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "cinder-quobyte-be259e9d-6649-49ba-9b73-ea399cdc5d3c" acquired by "delete_volume" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[16228407-9c76-440e-9025-501713d04e66]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c" returned: 0 in 0.520s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-be259e9d-6649-49ba-9b73-ea399cdc5d3c" returned: 0 in 0.174s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "cinder-quobyte-be259e9d-6649-49ba-9b73-ea399cdc5d3c" released by "delete_volume" :: held 0.975s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG cinder.quota [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Created reservations ['6cdff903-a4e9-4ccb-90e6-2f05be6bec32', 'bb7267c5-a32e-4963-8baf-8b171f339d95', '444f0594-79b0-4d74-ad6b-35b65ad0117f', '5319c36b-4b41-441e-a149-0093e6a67cdd'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:39 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 1 in 2.643s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Temporary image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 is fetched for user 076743c6ead24606910ddb7d804dea70. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da3019-22bc-4e7d-86a9-1bd651a94ba0]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.170s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.manager [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:40 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Deleted volume successfully. Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.404s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:40 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD Sep 25 21:33:40 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-b6b9a76b-2682-41a3-9b05-603c11750936 req-ff007908-aeb3-4f03-bd43-ecfd03c58212 tempest-VolumesGetTestJSON-522133568 None] Lock "cinder-be259e9d-6649-49ba-9b73-ea399cdc5d3c-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:42 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 0 in 2.655s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:42 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD Sep 25 21:33:42 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:43 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:33:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (2d5d3333-1066-4f86-8c84-6c9f20c77d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2bd0dd-1341-4111-8b17-5f0b3989073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2bd0dd-1341-4111-8b17-5f0b3989073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1562245868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90a82ea-8546-4857-910a-a7f4b672cbe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:44Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f189af-8983-47a6-ad67-78288b43e4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f189af-8983-47a6-ad67-78288b43e4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fbb360-d59d-47da-ae51-047d28afdf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fbb360-d59d-47da-ae51-047d28afdf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90a82ea-8546-4857-910a-a7f4b672cbe5', 'volume_name': 'volume-f90a82ea-8546-4857-910a-a7f4b672cbe5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9f02c6-1419-4c3e-9b03-29bbcff08f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9f02c6-1419-4c3e-9b03-29bbcff08f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b9915-1a24-4eb4-9b40-e9ebc20e9e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Volume f90a82ea-8546-4857-910a-a7f4b672cbe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90a82ea-8546-4857-910a-a7f4b672cbe5', 'volume_size': 1} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1562245868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90a82ea-8546-4857-910a-a7f4b672cbe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:44Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Creating volume f90a82ea-8546-4857-910a-a7f4b672cbe5 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:33:44 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:44 devstack quobyte-client[84349]: System call of process 96806 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:44 devstack quobyte-client[84349]: System call of process 96806 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:44 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=79, name=volume-f90a82ea-8546-4857-910a-a7f4b672cbe5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 1073741824" returned: 0 in 0.560s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] <== create_volume: return (828ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:33:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:45 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b9915-1a24-4eb4-9b40-e9ebc20e9e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90a82ea-8546-4857-910a-a7f4b672cbe5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3dd815-9b4b-401d-ae2c-3cfa1fbbe04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 1 in 2.917s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0900eb0-f9ba-4463-8ad6-1b214f6e176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd251205ee545f290c91cd9d1025608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:34Z,use_quota=True,user_id='076743c6ead24606910ddb7d804dea70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Creating volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:33:45 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:33:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:45 devstack quobyte-client[84349]: System call of process 96825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:46 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=80, name=volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:46 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Volume volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 (f90a82ea-8546-4857-910a-a7f4b672cbe5): created successfully Sep 25 21:33:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3dd815-9b4b-401d-ae2c-3cfa1fbbe04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:46 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (2d5d3333-1066-4f86-8c84-6c9f20c77d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-acdb155f-4971-4851-b007-eb5ef7524b2f req-c70e485d-7d1d-4b82-8816-cce4c4011d73 tempest-TestMinimumBasicScenario-1479618749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-babec841-6b53-4a20-a5fc-41570afc2488 tempest-VolumesTestJSON-1711376354 None] Created volume successfully. Sep 25 21:33:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e 1073741824" returned: 0 in 1.322s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 0 in 0.496s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] <== create_volume: return (1880ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:47 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-acdb155f-4971-4851-b007-eb5ef7524b2f req-c70e485d-7d1d-4b82-8816-cce4c4011d73 tempest-TestMinimumBasicScenario-1479618749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-acdb155f-4971-4851-b007-eb5ef7524b2f req-c70e485d-7d1d-4b82-8816-cce4c4011d73 tempest-TestMinimumBasicScenario-1479618749 None] Terminate volume connection completed successfully. Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-acdb155f-4971-4851-b007-eb5ef7524b2f req-c70e485d-7d1d-4b82-8816-cce4c4011d73 tempest-TestMinimumBasicScenario-1479618749 None] Deleting attachment b62b5686-ff12-4fb0-8448-e57280b48dbd. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:33:47 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (d27878c2-f2d7-433a-831b-dd08037aa55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6e884a-4d4c-47d0-a50c-cc6a79f5ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6e884a-4d4c-47d0-a50c-cc6a79f5ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425803615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48eeafc0-a874-4308-a3f3-7a1903432a51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:47Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29efa24-8249-4b33-ad54-af8083578d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29efa24-8249-4b33-ad54-af8083578d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c1fdc6-5093-4818-88d1-3e0d1fecfe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c1fdc6-5093-4818-88d1-3e0d1fecfe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48eeafc0-a874-4308-a3f3-7a1903432a51', 'volume_name': 'volume-48eeafc0-a874-4308-a3f3-7a1903432a51', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a3ac02-150a-44b6-a80c-8e749364f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a3ac02-150a-44b6-a80c-8e749364f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b61516a-31da-47e5-95a7-7cfa9c8f8e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:47 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Volume 48eeafc0-a874-4308-a3f3-7a1903432a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48eeafc0-a874-4308-a3f3-7a1903432a51', 'volume_size': 1} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425803615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48eeafc0-a874-4308-a3f3-7a1903432a51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:47Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Creating volume 48eeafc0-a874-4308-a3f3-7a1903432a51 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:33:47 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:47 devstack quobyte-client[84349]: System call of process 96830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:47 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=81, name=volume-48eeafc0-a874-4308-a3f3-7a1903432a51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:47 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Attempting download of 2199a398-bfd7-4957-90d5-dd1a3b7e8606 ((None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}])) to volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15db027-bc31-4e48-a744-78393db8ecb7]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2199a398-bfd7-4957-90d5-dd1a3b7e8606_1guw0926 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51 1073741824" returned: 0 in 0.493s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51" returned: 0 in 0.157s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] <== create_volume: return (737ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b61516a-31da-47e5-95a7-7cfa9c8f8e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48eeafc0-a874-4308-a3f3-7a1903432a51', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e4f6a2-6481-4062-8171-8a5655a3d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:48 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Volume volume-48eeafc0-a874-4308-a3f3-7a1903432a51 (48eeafc0-a874-4308-a3f3-7a1903432a51): created successfully Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e4f6a2-6481-4062-8171-8a5655a3d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (d27878c2-f2d7-433a-831b-dd08037aa55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "cinder-eb112421-a90c-4fa6-a578-04aecfbb62dc-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2199a398-bfd7-4957-90d5-dd1a3b7e8606_1guw0926" returned: 0 in 0.792s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2199a398-bfd7-4957-90d5-dd1a3b7e8606_1guw0926 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "cinder-eb112421-a90c-4fa6-a578-04aecfbb62dc-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2d008feb-c5be-4e64-bc4b-ba4de8c7eb65 tempest-VolumesTestJSON-1711376354 None] Created volume successfully. Sep 25 21:33:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "cinder-quobyte-eb112421-a90c-4fa6-a578-04aecfbb62dc" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2199a398-bfd7-4957-90d5-dd1a3b7e8606_1guw0926" returned: 1 in 0.600s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2199a398-bfd7-4957-90d5-dd1a3b7e8606_1guw0926' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[36519406-fa32-489f-9c87-e92348b977c0]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "cinder-quobyte-eb112421-a90c-4fa6-a578-04aecfbb62dc" acquired by "delete_volume" :: waited 0.197s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b7e3f3-9d70-4e48-a8af-81f820bd8b23]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:50 devstack quobyte-client[84349]: System call of process 96839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:50 devstack quobyte-client[84349]: System call of process 96839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:50 devstack quobyte-client[84349]: System call of process 96839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:50 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (3771f622-6c53-4300-ad3c-ffa4db027016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9146ef-64ba-4b87-9311-232857f3a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9146ef-64ba-4b87-9311-232857f3a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686608735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e208c512-7e06-4b23-9496-dd0fa82b6323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:50Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb5556e-3f46-46bf-9ccf-4b2be48831ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb5556e-3f46-46bf-9ccf-4b2be48831ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135727e-f73e-4b7a-9a1d-8e03fd7bf002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135727e-f73e-4b7a-9a1d-8e03fd7bf002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e208c512-7e06-4b23-9496-dd0fa82b6323', 'volume_name': 'volume-e208c512-7e06-4b23-9496-dd0fa82b6323', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb890aa2-3fe2-4239-8983-173988b004e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb890aa2-3fe2-4239-8983-173988b004e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1368c3be-7ba8-4874-83b1-1dbe4956d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:50 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Volume e208c512-7e06-4b23-9496-dd0fa82b6323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e208c512-7e06-4b23-9496-dd0fa82b6323', 'volume_size': 1} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686608735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e208c512-7e06-4b23-9496-dd0fa82b6323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30f9434595db4ca682525aa65823302d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:33:50Z,use_quota=True,user_id='08c8f97be2ef4c1f9a5ffedd68dc27b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Creating volume e208c512-7e06-4b23-9496-dd0fa82b6323 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:33:50 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:33:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc" returned: 0 in 1.375s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:51 devstack quobyte-client[84349]: System call of process 96846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:51 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=82, name=volume-e208c512-7e06-4b23-9496-dd0fa82b6323, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD" returned: 1 in 0.953s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] 2199a398-bfd7-4957-90d5-dd1a3b7e8606 was raw, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-eb112421-a90c-4fa6-a578-04aecfbb62dc" returned: 0 in 0.330s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:51 devstack quobyte-client[84349]: System call of process 96850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:51 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=80, name=volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323 1073741824" returned: 0 in 0.596s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "cinder-quobyte-eb112421-a90c-4fa6-a578-04aecfbb62dc" released by "delete_volume" :: held 2.146s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 0 in 0.579s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2199a398-bfd7-4957-90d5-dd1a3b7e8606_q7dy86_pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:33:51 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:33:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:52 devstack quobyte-client[84349]: System call of process 96854 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323" returned: 0 in 0.587s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] <== create_volume: return (1267ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1368c3be-7ba8-4874-83b1-1dbe4956d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e208c512-7e06-4b23-9496-dd0fa82b6323', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91fd77-c382-4ded-96ba-1df959efc2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e 1G" returned: 0 in 0.498s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Created reservations ['9c04682f-7117-4394-adb4-0e3f2efb774c', '735163f5-278c-457c-8b70-867d5c6d404f', '43d3f219-9128-407c-9f28-b8c88427e092', '1585feea-5294-43fa-ba35-444d94234b53'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Volume volume-e208c512-7e06-4b23-9496-dd0fa82b6323 (e208c512-7e06-4b23-9496-dd0fa82b6323): created successfully Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91fd77-c382-4ded-96ba-1df959efc2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Flow 'volume_create_manager' (3771f622-6c53-4300-ad3c-ffa4db027016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:52 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0cdbd3c2-cf0e-487f-a712-1a3e75cdd80b tempest-VolumesTestJSON-1711376354 None] Created volume successfully. Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74cf8e-5c96-4696-ab2f-e7a2022e0c6d]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:53 devstack quobyte-client[84349]: System call of process 96857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 0 in 0.574s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.361s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:53 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Deleted volume successfully. Sep 25 21:33:53 devstack quobyte-client[84349]: System call of process 96861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 1 in 0.749s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Downloaded image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 ((None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}])) to volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Temporary image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 for user 076743c6ead24606910ddb7d804dea70 is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:33:53 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Marking volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Copying metadata from image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 to a0900eb0-f9ba-4463-8ad6-1b214f6e176e. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Creating volume glance metadata for volume a0900eb0-f9ba-4463-8ad6-1b214f6e176e backed by image 2199a398-bfd7-4957-90d5-dd1a3b7e8606 with: {'image_id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0e6d19b3fe03309329ec2d01ee7b8807', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-832b0c9c-214b-444e-971e-488aece53590 tempest-TestMinimumBasicScenario-1479618749 None] Lock "cinder-eb112421-a90c-4fa6-a578-04aecfbb62dc-delete_volume" released by "delete_volume" :: held 5.135s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76f8174-e869-46c2-93a6-0a9914569609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e', 'volume_size': 1, 'image_id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6d19b3fe03309329ec2d01ee7b8807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd251205ee545f290c91cd9d1025608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84290ecdd9973866741140d00b6033a4e8ba390797f3d79d7224a7a4f49451f31f2d5bfaadb5608718bcb3c61a881fd9ad2ffc41b5238d7d01112ac8106f515f', 'id': '2199a398-bfd7-4957-90d5-dd1a3b7e8606', 'created_at': datetime.datetime(2025, 9, 25, 19, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2199a398-bfd7-4957-90d5-dd1a3b7e8606/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8df40-f97f-4bee-9d88-e9aeeb125a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:33:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Volume volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e (a0900eb0-f9ba-4463-8ad6-1b214f6e176e): created successfully Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8df40-f97f-4bee-9d88-e9aeeb125a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Flow 'volume_create_manager' (4a158b54-bae7-436c-a062-c31a96be1b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:33:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-df1cb160-aaa0-4e6f-9bcf-767654c4a8c8 tempest-VolumeImageDependencyTests-207798334 None] Created volume successfully. Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-e208c512-7e06-4b23-9496-dd0fa82b6323-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-e208c512-7e06-4b23-9496-dd0fa82b6323-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-quobyte-e208c512-7e06-4b23-9496-dd0fa82b6323" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-e208c512-7e06-4b23-9496-dd0fa82b6323" acquired by "delete_volume" :: waited 0.067s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333cf22-f9b4-41b5-8af3-32b29397c3d2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Acquiring lock "cinder-a0900eb0-f9ba-4463-8ad6-1b214f6e176e-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "cinder-a0900eb0-f9ba-4463-8ad6-1b214f6e176e-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:56 devstack quobyte-client[84349]: System call of process 96886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:56 devstack quobyte-client[84349]: System call of process 96886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:56 devstack quobyte-client[84349]: System call of process 96886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:56 devstack quobyte-client[84349]: System call of process 96886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323" returned: 0 in 1.222s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e208c512-7e06-4b23-9496-dd0fa82b6323" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:57 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Acquiring lock "cinder-quobyte-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-e208c512-7e06-4b23-9496-dd0fa82b6323" released by "delete_volume" :: held 1.926s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "cinder-quobyte-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" acquired by "delete_volume" :: waited 0.083s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f07432-3e17-4f6f-9c63-b404fe61a48b]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Created reservations ['362f51fc-b3c2-4f63-9f8f-f8254dfd183f', '7c7a5c4d-cc1f-43f2-b5cb-f45d5632b249', 'd23de9e3-1956-4826-a70e-c236c7a064a5', '4edbc933-ad6b-4062-a25f-8910ca55c352'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 0 in 0.648s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:58 devstack quobyte-client[84349]: System call of process 96910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:58 devstack quobyte-client[84349]: System call of process 96910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 1 in 0.693s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-48eeafc0-a874-4308-a3f3-7a1903432a51-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" returned: 0 in 0.356s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.551s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-48eeafc0-a874-4308-a3f3-7a1903432a51-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "cinder-quobyte-a0900eb0-f9ba-4463-8ad6-1b214f6e176e" released by "delete_volume" :: held 2.061s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Deleted volume successfully. Sep 25 21:33:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-quobyte-48eeafc0-a874-4308-a3f3-7a1903432a51" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-48eeafc0-a874-4308-a3f3-7a1903432a51" acquired by "delete_volume" :: waited 0.026s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9687b687-65e6-4a7e-8fd5-76ed5660b567 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-e208c512-7e06-4b23-9496-dd0fa82b6323-delete_volume" released by "delete_volume" :: held 4.550s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4c40d-1ddc-4ee6-8e78-36a3a4b8de79]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:33:59 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Created reservations ['d1ee12e3-746b-4952-84ba-a5c4283bfe32', '848fb86d-a367-4795-85fa-ce2560d2198c', 'd64bde30-8989-4780-b020-4dbf8aef2292', '768bc62f-e198-434d-9502-a30cb2e79810'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:00 devstack quobyte-client[84349]: System call of process 96916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51" returned: 0 in 0.720s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-48eeafc0-a874-4308-a3f3-7a1903432a51" returned: 0 in 0.225s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-48eeafc0-a874-4308-a3f3-7a1903432a51" released by "delete_volume" :: held 1.183s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.331s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:34:01 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Deleted volume successfully. Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-652360af-f36a-4fce-968d-9aae80923046 tempest-VolumeImageDependencyTests-207798334 None] Lock "cinder-a0900eb0-f9ba-4463-8ad6-1b214f6e176e-delete_volume" released by "delete_volume" :: held 4.926s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Created reservations ['64c5fb10-ae3a-4ec6-b432-80e98554fa53', '6a341912-88fc-4708-9908-d66be9017db9', '82abe800-9135-4f8d-92b5-29008d809ed7', 'f238d1d3-0285-4236-89f6-a3f37a898089'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:34:01 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Deleted volume successfully. Sep 25 21:34:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f3edb6c-5bcf-46e8-a61a-6d45987b4898 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-48eeafc0-a874-4308-a3f3-7a1903432a51-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-f90a82ea-8546-4857-910a-a7f4b672cbe5-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-f90a82ea-8546-4857-910a-a7f4b672cbe5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "cinder-quobyte-f90a82ea-8546-4857-910a-a7f4b672cbe5" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-f90a82ea-8546-4857-910a-a7f4b672cbe5" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d921132-4fb1-4c6c-ad58-50639126f8c2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:03 devstack quobyte-client[84349]: System call of process 96922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:03 devstack quobyte-client[84349]: System call of process 96922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:03 devstack quobyte-client[84349]: System call of process 96922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:03 devstack quobyte-client[84349]: System call of process 96922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5" returned: 0 in 0.709s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f90a82ea-8546-4857-910a-a7f4b672cbe5" returned: 0 in 0.208s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-quobyte-f90a82ea-8546-4857-910a-a7f4b672cbe5" released by "delete_volume" :: held 1.223s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Created reservations ['36504d10-bc64-422f-8715-07ef1f36f37b', '039e6db9-2217-4f5a-8719-4043ac32c8f4', '6adce2f4-1000-4760-8856-25336d0177ec', '9ea346b6-05f5-42d9-8e2d-68d9dc3c83b1'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.128s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:34:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Deleted volume successfully. Sep 25 21:34:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0829c7e6-389e-4722-b2ec-f23588c16cd9 tempest-VolumesTestJSON-1711376354 None] Lock "cinder-f90a82ea-8546-4857-910a-a7f4b672cbe5-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e840eed5-f96b-4ad0-a394-e68dc4053c27 tempest-GroupSnapshotsV319Test-1776216808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e840eed5-f96b-4ad0-a394-e68dc4053c27 tempest-GroupSnapshotsV319Test-1776216808 None] Group tempest-GroupSnapshotsV319Test-Group-1758418718: creating Sep 25 21:34:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e840eed5-f96b-4ad0-a394-e68dc4053c27 tempest-GroupSnapshotsV319Test-1776216808 None] Group tempest-GroupSnapshotsV319Test-Group-1758418718: created successfully Sep 25 21:34:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e840eed5-f96b-4ad0-a394-e68dc4053c27 tempest-GroupSnapshotsV319Test-1776216808 None] Create group completed successfully. Sep 25 21:34:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Flow 'volume_create_manager' (911f4ebc-8d6d-4dac-bc3a-843f0bd7db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412b1fab-051b-45d9-841e-02b65f8619f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412b1fab-051b-45d9-841e-02b65f8619f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1846527126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9520241-92d1-49d9-bcbd-b4889d2208fb,host='devstack@QuobyteHD#QuobyteHD',id=8154eb75-294f-4107-bb1a-2b8704057cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f095be4f0bf14f8186626dbab97a5221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:34:14Z,use_quota=True,user_id='c380415a46d04c1ca0324c548d332136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8fc7956-4a0d-4fe7-9cf2-be76512d0499),volume_type_id=c8fc7956-4a0d-4fe7-9cf2-be76512d0499)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaa2c8a-e4c9-41e0-9c59-5aa8ec0f5b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaa2c8a-e4c9-41e0-9c59-5aa8ec0f5b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97615359-4720-4847-9139-5f5bfe73eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97615359-4720-4847-9139-5f5bfe73eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8154eb75-294f-4107-bb1a-2b8704057cd1', 'volume_name': 'volume-8154eb75-294f-4107-bb1a-2b8704057cd1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25257001-e8ee-44a5-8ffe-7227497efe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25257001-e8ee-44a5-8ffe-7227497efe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abe0b9-8082-497e-ab15-cc00c19eac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:14 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Volume 8154eb75-294f-4107-bb1a-2b8704057cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8154eb75-294f-4107-bb1a-2b8704057cd1', 'volume_size': 1} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d9520241-92d1-49d9-bcbd-b4889d2208fb,created_at=2025-09-25T19:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1846527126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9520241-92d1-49d9-bcbd-b4889d2208fb,host='devstack@QuobyteHD#QuobyteHD',id=8154eb75-294f-4107-bb1a-2b8704057cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f095be4f0bf14f8186626dbab97a5221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:34:14Z,use_quota=True,user_id='c380415a46d04c1ca0324c548d332136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8fc7956-4a0d-4fe7-9cf2-be76512d0499),volume_type_id=c8fc7956-4a0d-4fe7-9cf2-be76512d0499)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Creating volume 8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:34:14 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:14 devstack quobyte-client[84349]: System call of process 96965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:14 devstack quobyte-client[84349]: System call of process 96965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:14 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=83, name=volume-8154eb75-294f-4107-bb1a-2b8704057cd1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 1073741824" returned: 0 in 0.576s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1" returned: 0 in 0.172s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abe0b9-8082-497e-ab15-cc00c19eac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8154eb75-294f-4107-bb1a-2b8704057cd1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9de4a-a77a-4933-bbdd-67c9ad6e9fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:15 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Volume volume-8154eb75-294f-4107-bb1a-2b8704057cd1 (8154eb75-294f-4107-bb1a-2b8704057cd1): created successfully Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9de4a-a77a-4933-bbdd-67c9ad6e9fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Flow 'volume_create_manager' (911f4ebc-8d6d-4dac-bc3a-843f0bd7db0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:34:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-09534d80-30c3-4c74-807c-73db8d6000b7 tempest-GroupSnapshotsV319Test-1776216808 None] Created volume successfully. Sep 25 21:34:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] GroupSnapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: creating. Sep 25 21:34:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Group snapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: creating. {{(pid=84334) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Creating offline snapshot 9d095c8a-8345-4751-bf97-6c85c3b9413a of volume 8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac81d2b-a5c4-4f79-90df-5f7e17eb5131]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:17 devstack quobyte-client[84349]: System call of process 96970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:17 devstack quobyte-client[84349]: System call of process 96970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1" returned: 0 in 0.674s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:17 devstack quobyte-client[84349]: System call of process 96973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:17 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=84, name=volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a 1G" returned: 0 in 0.429s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8154eb75-294f-4107-bb1a-2b8704057cd1 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:18 devstack quobyte-client[84349]: System call of process 96977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:18 devstack quobyte-client[84349]: System call of process 96977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:18 devstack quobyte-client[84349]: System call of process 96977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "qemu-img rebase -u -b volume-8154eb75-294f-4107-bb1a-2b8704057cd1 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.232s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.info" returned: 0 in 0.118s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.info" returned: 0 in 0.105s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a0da6044-a890-4f07-aa34-77a4e43a54c3 tempest-GroupSnapshotsV319Test-1776216808 None] group_snapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: created successfully Sep 25 21:34:20 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] group_snapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: deleting Sep 25 21:34:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] group_snapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: deleting {{(pid=84334) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "cinder-quobyte-9d095c8a-8345-4751-bf97-6c85c3b9413a" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-9d095c8a-8345-4751-bf97-6c85c3b9413a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Deleting offline snapshot 9d095c8a-8345-4751-bf97-6c85c3b9413a of volume 8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] snapshot_file for this snap is: volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[01993b5f-8f62-44a9-a6b3-3bf8d08c8ba5]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:21 devstack quobyte-client[84349]: System call of process 96985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:21 devstack quobyte-client[84349]: System call of process 96985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:21 devstack quobyte-client[84349]: System call of process 96985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.475s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8154eb75-294f-4107-bb1a-2b8704057cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8c4499-1c4c-4aad-9b0e-bf0a37ecdd09]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1" returned: 0 in 0.477s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:21 devstack quobyte-client[84349]: System call of process 96991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.267s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1.9d095c8a-8345-4751-bf97-6c85c3b9413a" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-9d095c8a-8345-4751-bf97-6c85c3b9413a" released by "_delete_snapshot" :: held 1.749s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" released by "delete_snapshot" :: held 1.774s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:22 devstack cinder-volume[84334]: WARNING cinder.quota [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830775488 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830775488, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:34:22 devstack cinder-volume[84334]: WARNING cinder.quota [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830775488 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830775488, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] Created reservations ['41e6262c-a892-42f6-9dae-85882402c1ac', '63e0783d-09f1-43fe-834a-59b179493b7a', 'fabbea2b-a6e2-4708-9759-cc9ad2e6816f', 'f22d139c-57bb-48af-99c8-b005c9c3ee3c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:22 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=75,cinder:UPDATE=88,cinder:INSERT=15,cinder:DELETE=10 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:34:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ff76be2b-edb0-44e1-94f7-d8d794cebcd8 tempest-GroupSnapshotsV319Test-1776216808 None] group_snapshot a89a25aa-70c6-498c-8794-c07eb25f13a0: deleted successfully Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=93,cinder:INSERT=30,cinder:SELECT=59,cinder:DELETE=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:34:24 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" acquired by "delete_volume" :: waited 0.020s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b0c32-213c-4d6f-9db6-3152228460da]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1" returned: 0 in 0.466s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8154eb75-294f-4107-bb1a-2b8704057cd1" returned: 0 in 0.157s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "cinder-quobyte-8154eb75-294f-4107-bb1a-2b8704057cd1" released by "delete_volume" :: held 0.808s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Created reservations ['1e223b7f-4f12-4e4d-b9ef-b81ac814d175'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:25 devstack cinder-volume[84334]: WARNING cinder.quota [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1830775488 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1830775488, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Created reservations ['281b206a-da15-4a70-9c0e-fcfe5d3bd899', '986bba06-421f-421c-a4fa-732bb356d1aa', '69be371f-350a-4d88-9e79-9912469aeb76', '278212b2-82ec-4672-91ea-822ffbe23d6b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.100s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:25 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:34:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9cc66a05-3d14-4ac5-82d6-3e281229b631 tempest-GroupSnapshotsV319Test-1776216808 None] Delete group completed successfully. Sep 25 21:34:35 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:34:35 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:34:39 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:39 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Flow 'volume_create_manager' (bcf6327a-1121-466b-9700-832a994aef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0d2cec-511a-42ce-9bc8-8dc600abcb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0d2cec-511a-42ce-9bc8-8dc600abcb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1222378814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738e0c9e-6cd1-4258-b790-734c57cd35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ddc31fbe2b467181da81c3ca9b67ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:34:39Z,use_quota=True,user_id='8fe95883e3eb47dc8bc565643ae66702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14b99db-8559-4326-8567-b97b7061b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14b99db-8559-4326-8567-b97b7061b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ec239f-df03-476e-80e0-06bc2e5def9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ec239f-df03-476e-80e0-06bc2e5def9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738e0c9e-6cd1-4258-b790-734c57cd35a7', 'volume_name': 'volume-738e0c9e-6cd1-4258-b790-734c57cd35a7', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5d587-f117-4ea1-b3a4-c1743a82a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5d587-f117-4ea1-b3a4-c1743a82a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2366a186-ca55-442d-9b60-cbe07131ce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:40 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Volume 738e0c9e-6cd1-4258-b790-734c57cd35a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738e0c9e-6cd1-4258-b790-734c57cd35a7', 'volume_size': 1} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1222378814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738e0c9e-6cd1-4258-b790-734c57cd35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ddc31fbe2b467181da81c3ca9b67ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:34:39Z,use_quota=True,user_id='8fe95883e3eb47dc8bc565643ae66702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Creating volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:34:40 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:40 devstack quobyte-client[84349]: System call of process 97010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:34:40 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=86, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.172s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 1073741824" returned: 0 in 0.516s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7" returned: 0 in 0.132s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:34:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2366a186-ca55-442d-9b60-cbe07131ce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738e0c9e-6cd1-4258-b790-734c57cd35a7', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad955d-c003-4942-bb9e-9b203350f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:34:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Volume volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 (738e0c9e-6cd1-4258-b790-734c57cd35a7): created successfully Sep 25 21:34:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad955d-c003-4942-bb9e-9b203350f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:34:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Flow 'volume_create_manager' (bcf6327a-1121-466b-9700-832a994aef8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:34:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5c8aa510-e7a9-47e1-9ee3-415644a3dbbe tempest-SnapshotsActionsTest-591917940 None] Created volume successfully. Sep 25 21:34:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Creating offline snapshot 71672f2f-3432-4e7c-92d7-72ed94ffce05 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764dbbd-082c-42f2-ba60-0ea7d29f2316]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:42 devstack quobyte-client[84349]: System call of process 97015 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7" returned: 0 in 0.509s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:42 devstack quobyte-client[84349]: System call of process 97018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:42 devstack quobyte-client[84349]: System call of process 97018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:42 devstack quobyte-client[84349]: System call of process 97018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:43 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=87, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 1G" returned: 0 in 0.319s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.191s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.131s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.138s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.info" returned: 0 in 0.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.info" returned: 0 in 0.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ea06c95a-421f-4bca-8b35-14237e6e8f0a tempest-SnapshotsActionsTest-591917940 None] Create snapshot completed successfully Sep 25 21:34:45 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Creating offline snapshot 540385a3-10c1-4db1-9aee-1cec8de2cba2 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:34:45 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d20742-33b3-4eb1-aeb2-f83ee8327ed4]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:46 devstack quobyte-client[84349]: System call of process 97029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:46 devstack quobyte-client[84349]: System call of process 97029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:46 devstack quobyte-client[84349]: System call of process 97029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:46 devstack quobyte-client[84349]: System call of process 97029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.530s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:46 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=89, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 1G" returned: 0 in 0.336s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.223s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.112s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.656s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:47 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-091ab032-78cc-4e4f-87ac-0147cea5a303 tempest-SnapshotsActionsTest-591917940 None] Create snapshot completed successfully Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-540385a3-10c1-4db1-9aee-1cec8de2cba2-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-540385a3-10c1-4db1-9aee-1cec8de2cba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-540385a3-10c1-4db1-9aee-1cec8de2cba2" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-540385a3-10c1-4db1-9aee-1cec8de2cba2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Deleting offline snapshot 540385a3-10c1-4db1-9aee-1cec8de2cba2 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] snapshot_file for this snap is: volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70590c-b928-4b3a-b32c-e75809d7e991]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:49 devstack quobyte-client[84349]: System call of process 97040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.435s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[514558f9-56c2-4db0-a9cc-57f174a80c70]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.437s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.304s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.540385a3-10c1-4db1-9aee-1cec8de2cba2" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-540385a3-10c1-4db1-9aee-1cec8de2cba2" released by "_delete_snapshot" :: held 1.621s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_snapshot" :: held 1.640s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:51 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Created reservations ['d8e8de38-7ca6-42b1-a000-e0f44d302ed0', '632ccadf-d778-42d6-baa4-ce7895d1ccac', 'a7b90b32-2e28-4e28-a99c-a204b49c6750', 'b9f3a6be-f520-42ce-9cb9-49868b4e7650'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:51 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Delete snapshot completed successfully. Sep 25 21:34:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e2f4d750-6242-421a-bfd7-87e5d618b3c8 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-540385a3-10c1-4db1-9aee-1cec8de2cba2-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Creating offline snapshot 1b7c32a8-1e45-4fce-a5f8-ad13397be707 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:34:52 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3fb28-ce93-4346-b21b-07b97f4f7c3f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.398s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:53 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=90, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 1G" returned: 0 in 0.261s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:53 devstack quobyte-client[84349]: System call of process 97057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.126s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.105s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.263s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:34:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-01d76ad4-8789-44fe-a0e4-385684f50bd1 tempest-SnapshotsActionsTest-591917940 None] Create snapshot completed successfully Sep 25 21:34:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-1b7c32a8-1e45-4fce-a5f8-ad13397be707-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-1b7c32a8-1e45-4fce-a5f8-ad13397be707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-1b7c32a8-1e45-4fce-a5f8-ad13397be707" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-1b7c32a8-1e45-4fce-a5f8-ad13397be707" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Deleting offline snapshot 1b7c32a8-1e45-4fce-a5f8-ad13397be707 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] snapshot_file for this snap is: volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab97eaa-8e72-4ba9-853c-8cca5ab61f33]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:55 devstack quobyte-client[84349]: System call of process 97062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2783e-bf8b-4d2e-aa3e-4d186d174b71]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:55 devstack quobyte-client[84349]: System call of process 97065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:55 devstack quobyte-client[84349]: System call of process 97065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:55 devstack quobyte-client[84349]: System call of process 97065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:55 devstack quobyte-client[84349]: System call of process 97065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.438s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.366s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.1b7c32a8-1e45-4fce-a5f8-ad13397be707" returned: 0 in 0.133s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-1b7c32a8-1e45-4fce-a5f8-ad13397be707" released by "_delete_snapshot" :: held 1.716s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_snapshot" :: held 1.737s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Created reservations ['4cdd4b2e-2eb9-472a-b1e7-b0877a60725a', '47b0f12d-0c07-4456-bd40-4f848b70bf3c', 'a0adf81b-f405-4194-b1e3-086a4d97128f', 'ea723203-0850-4916-9b47-c426116831ce'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:34:57 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Delete snapshot completed successfully. Sep 25 21:34:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3f91bf3b-d0cd-4b66-bf51-bc61c832c3fa tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-1b7c32a8-1e45-4fce-a5f8-ad13397be707-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:34:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:34:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:34:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:34:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Creating offline snapshot 0078704a-ff68-4e43-a38a-36ff55279a98 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:34:58 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa848b1-b86c-4c4c-8e30-7dfa3a3d687a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:34:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:59 devstack quobyte-client[84349]: System call of process 97079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:34:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.875s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:34:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:34:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:34:59 devstack quobyte-client[84349]: System call of process 97086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:00 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=91, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 1G" returned: 0 in 0.441s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:00 devstack quobyte-client[84349]: System call of process 97092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.159s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.173s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.152s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:01 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-974327d3-f42f-4a13-9c7f-c8521bde4f63 tempest-SnapshotsActionsTest-591917940 None] Create snapshot completed successfully Sep 25 21:35:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-0078704a-ff68-4e43-a38a-36ff55279a98-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-0078704a-ff68-4e43-a38a-36ff55279a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-0078704a-ff68-4e43-a38a-36ff55279a98" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-0078704a-ff68-4e43-a38a-36ff55279a98" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Deleting offline snapshot 0078704a-ff68-4e43-a38a-36ff55279a98 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] snapshot_file for this snap is: volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e33062-f798-4f8f-ba29-5a06ac5a7d08]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:02 devstack quobyte-client[84349]: System call of process 97099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:02 devstack quobyte-client[84349]: System call of process 97099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.454s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce00dbb-e99a-45ea-bbba-28fedec53947]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:03 devstack quobyte-client[84349]: System call of process 97105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.375s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:03 devstack quobyte-client[84349]: System call of process 97108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:03 devstack quobyte-client[84349]: System call of process 97108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.274s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.0078704a-ff68-4e43-a38a-36ff55279a98" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-0078704a-ff68-4e43-a38a-36ff55279a98" released by "_delete_snapshot" :: held 1.498s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_snapshot" :: held 1.547s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Created reservations ['b25d9fde-5386-445d-a09d-b218085201df', 'd3b7e1b6-5e4c-40b1-855b-98549f86cfaa', '2c268e47-a260-4aaf-bded-057c32629bf2', '16a146dd-9b32-4c19-82b6-b7655a21d252'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Delete snapshot completed successfully. Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-096d5d0d-070a-4cbb-a700-f305c7275156 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-0078704a-ff68-4e43-a38a-36ff55279a98-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Creating offline snapshot f4c0f306-e206-47af-ada4-6ef1d34e672a of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf244dd-8beb-4422-9955-c3bc4be99738]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.434s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:05 devstack quobyte-client[84349]: System call of process 97122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:05 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=92, name=volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a 1G" returned: 0 in 0.346s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img rebase -u -b volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 0.149s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 0.161s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:35:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 0.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.557s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fa095668-f941-4e54-b752-45ab08248edb tempest-SnapshotsActionsTest-591917940 None] Create snapshot completed successfully Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-f4c0f306-e206-47af-ada4-6ef1d34e672a-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-f4c0f306-e206-47af-ada4-6ef1d34e672a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.159s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_snapshot" :: waited 0.064s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Acquiring lock "cinder-quobyte-f4c0f306-e206-47af-ada4-6ef1d34e672a" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-f4c0f306-e206-47af-ada4-6ef1d34e672a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Deleting offline snapshot f4c0f306-e206-47af-ada4-6ef1d34e672a of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] snapshot_file for this snap is: volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcfce8a-46d7-4fce-9451-aac539e93c59]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:08 devstack quobyte-client[84349]: System call of process 97164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 1.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2b469-f78e-4c17-a3ed-7439b8f4ad9d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:09 devstack quobyte-client[84349]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:09 devstack quobyte-client[84349]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:09 devstack quobyte-client[84349]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.780s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 0.354s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.f4c0f306-e206-47af-ada4-6ef1d34e672a" returned: 0 in 0.180s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-f4c0f306-e206-47af-ada4-6ef1d34e672a" released by "_delete_snapshot" :: held 2.956s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_snapshot" :: held 2.993s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:10 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Created reservations ['d285480d-6460-4843-bfab-fccb28e91c3b', 'd01b9780-186b-4d74-bcdb-c30ea1e29a6f', '08902bbb-c253-4c2a-a52c-9e188196a93b', '2d00d1af-c1af-4e77-88b6-3f890b80d29c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Delete snapshot completed successfully. Sep 25 21:35:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-83395e00-1f8b-4f7a-9420-4dff1fb0b8f4 tempest-SnapshotsActionsTest-1392676457 None] Lock "cinder-f4c0f306-e206-47af-ada4-6ef1d34e672a-delete_snapshot" released by "delete_snapshot" :: held 3.792s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "cinder-71672f2f-3432-4e7c-92d7-72ed94ffce05-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-71672f2f-3432-4e7c-92d7-72ed94ffce05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "cinder-quobyte-71672f2f-3432-4e7c-92d7-72ed94ffce05" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-71672f2f-3432-4e7c-92d7-72ed94ffce05" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Deleting offline snapshot 71672f2f-3432-4e7c-92d7-72ed94ffce05 of volume 738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] snapshot_file for this snap is: volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68acbae-abfe-4009-9c75-71203dc9ac22]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:12 devstack quobyte-client[84349]: System call of process 97213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.487s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e0c9e-6cd1-4258-b790-734c57cd35a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967c1f6-766d-4530-819a-814b5903e36b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:13 devstack quobyte-client[84349]: System call of process 97226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:13 devstack quobyte-client[84349]: System call of process 97226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:13 devstack quobyte-client[84349]: System call of process 97226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7" returned: 0 in 0.745s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:14 devstack quobyte-client[84349]: System call of process 97250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:14 devstack quobyte-client[84349]: System call of process 97250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:14 devstack quobyte-client[84349]: System call of process 97250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.395s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7.71672f2f-3432-4e7c-92d7-72ed94ffce05" returned: 0 in 0.145s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-71672f2f-3432-4e7c-92d7-72ed94ffce05" released by "_delete_snapshot" :: held 2.337s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_snapshot" :: held 2.374s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Created reservations ['dd7c491f-f907-44b6-8a48-b76503fd5604', '7d42e6b5-0331-471d-99dc-7d6494659436', '219533a8-39dc-4ee4-9fd7-af20ebb252b2', '080d549c-e38b-4890-aa38-9e9907760e30'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Delete snapshot completed successfully. Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-09c51f7a-79e3-4b9a-8f0a-6f0f7a628983 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-71672f2f-3432-4e7c-92d7-72ed94ffce05-delete_snapshot" released by "delete_snapshot" :: held 2.923s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "cinder-738e0c9e-6cd1-4258-b790-734c57cd35a7-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-738e0c9e-6cd1-4258-b790-734c57cd35a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:15 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" acquired by "delete_volume" :: waited 0.021s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[570abd72-9cef-4706-8e4e-b8d1e8e3d5fe]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7" returned: 0 in 0.485s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-738e0c9e-6cd1-4258-b790-734c57cd35a7" returned: 0 in 0.203s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-quobyte-738e0c9e-6cd1-4258-b790-734c57cd35a7" released by "delete_volume" :: held 0.921s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Created reservations ['20645887-5b69-4b1d-8c9a-c964f7e8954d', '60ef4e97-5444-4362-9d78-404ce56760dd', '57cbf0b2-cf9c-476a-8afd-480084da2216', '9d52930a-e912-404a-89c1-9116c9e9a4a1'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.112s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:17 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Deleted volume successfully. Sep 25 21:35:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7413265-f015-4819-aafb-bd8013c96225 tempest-SnapshotsActionsTest-591917940 None] Lock "cinder-738e0c9e-6cd1-4258-b790-734c57cd35a7-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Flow 'volume_create_manager' (ea7be2a1-305e-4d54-8f0a-0c1ff9e7799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4750cbf-7da3-4a3e-abf1-909c9e4c9161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4750cbf-7da3-4a3e-abf1-909c9e4c9161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-36754852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7c64da-a600-4d73-ac9e-6382ba41c705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37b4cf0f6454152a0ad4599f4bc4bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:25Z,use_quota=True,user_id='b862cf79e2564b1c87d698a3e16c84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8183dee5-a52b-4b9a-8cbe-e49beff0b5d5),volume_type_id=8183dee5-a52b-4b9a-8cbe-e49beff0b5d5)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53a9842-d16b-4e59-85b6-e66338d673e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53a9842-d16b-4e59-85b6-e66338d673e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3999b8e-3374-4785-a83f-47648e55537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3999b8e-3374-4785-a83f-47648e55537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7c64da-a600-4d73-ac9e-6382ba41c705', 'volume_name': 'volume-8e7c64da-a600-4d73-ac9e-6382ba41c705', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a3f567-d066-4297-9a28-3aa0eb1139d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a3f567-d066-4297-9a28-3aa0eb1139d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98939d41-3395-41c4-a073-675746382c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:25 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume 8e7c64da-a600-4d73-ac9e-6382ba41c705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7c64da-a600-4d73-ac9e-6382ba41c705', 'volume_size': 1} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-36754852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7c64da-a600-4d73-ac9e-6382ba41c705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37b4cf0f6454152a0ad4599f4bc4bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:25Z,use_quota=True,user_id='b862cf79e2564b1c87d698a3e16c84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8183dee5-a52b-4b9a-8cbe-e49beff0b5d5),volume_type_id=8183dee5-a52b-4b9a-8cbe-e49beff0b5d5)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Creating volume 8e7c64da-a600-4d73-ac9e-6382ba41c705 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:35:25 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:25 devstack quobyte-client[84349]: System call of process 97272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:25 devstack quobyte-client[84349]: System call of process 97272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:25 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=93, name=volume-8e7c64da-a600-4d73-ac9e-6382ba41c705, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 1073741824" returned: 0 in 0.354s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.564s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98939d41-3395-41c4-a073-675746382c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7c64da-a600-4d73-ac9e-6382ba41c705', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ee775-5eac-4850-a4a7-cf2cdee101ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 (8e7c64da-a600-4d73-ac9e-6382ba41c705): created successfully Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ee775-5eac-4850-a4a7-cf2cdee101ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Flow 'volume_create_manager' (ea7be2a1-305e-4d54-8f0a-0c1ff9e7799a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8bd38f6c-4f11-4a4a-8bca-25e17cad2371 tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Created volume successfully. Sep 25 21:35:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:28 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:28 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-06f15501-0459-4c64-a68e-b1b0ce06e51e tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Retype volume completed successfully. Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "cinder-8e7c64da-a600-4d73-ac9e-6382ba41c705-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "cinder-8e7c64da-a600-4d73-ac9e-6382ba41c705-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:29 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "cinder-quobyte-8e7c64da-a600-4d73-ac9e-6382ba41c705" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "cinder-quobyte-8e7c64da-a600-4d73-ac9e-6382ba41c705" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958b3ea-1309-4f0a-8f22-ba4ea458a820]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705" returned: 0 in 0.451s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-8e7c64da-a600-4d73-ac9e-6382ba41c705" returned: 0 in 0.225s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "cinder-quobyte-8e7c64da-a600-4d73-ac9e-6382ba41c705" released by "delete_volume" :: held 0.869s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:30 devstack cinder-volume[84334]: WARNING cinder.quota [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:35:30 devstack cinder-volume[84334]: WARNING cinder.quota [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Created reservations ['e2d2a61f-f3d6-48b2-bb65-f1782773fea4', '4c8ca1e0-f064-4415-9486-efe4784ca740', '46a21297-1abb-424b-87ab-41abd1add174', '69d67d99-09a2-4904-af43-5bcab7b973fd'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.124s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:31 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:31 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Deleted volume successfully. Sep 25 21:35:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-07e45466-7c29-4afc-9296-5c596dbac94a tempest-VolumeRetypeWithoutMigrationTest-1294122109 None] Lock "cinder-8e7c64da-a600-4d73-ac9e-6382ba41c705-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=46,cinder:UPDATE=51,cinder:DELETE=6,cinder:INSERT=13 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:35:36 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=64,cinder:SELECT=53,cinder:DELETE=3,cinder:INSERT=15 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:35:36 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:36 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Flow 'volume_create_manager' (59b08663-3439-46b0-8a35-56bdaef5be4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b75d49-24cb-4dd8-9f5c-603737624f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b75d49-24cb-4dd8-9f5c-603737624f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-215664198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523003aa02834a2eb8f89878c54786e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:37Z,use_quota=True,user_id='6f3c9b26a8014a1dbfd3746870def046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fa5b61-b935-4a69-a7fa-8684227f21a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fa5b61-b935-4a69-a7fa-8684227f21a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2c0726-3afe-4764-acf1-65210acf1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2c0726-3afe-4764-acf1-65210acf1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef', 'volume_name': 'volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d27967-9a7f-4c91-b655-c7d085de10cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d27967-9a7f-4c91-b655-c7d085de10cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca60b44-d6bf-4e72-98d9-b91e40680da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef', 'volume_size': 1} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-215664198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523003aa02834a2eb8f89878c54786e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:37Z,use_quota=True,user_id='6f3c9b26a8014a1dbfd3746870def046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Creating volume b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:35:37 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: System call of process 97285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:37 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=94, name=volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef 1073741824" returned: 0 in 0.378s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" returned: 0 in 0.095s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca60b44-d6bf-4e72-98d9-b91e40680da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c64cc-fb25-4a20-9860-65fbe3221b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:37 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef (b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef): created successfully Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c64cc-fb25-4a20-9860-65fbe3221b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Flow 'volume_create_manager' (59b08663-3439-46b0-8a35-56bdaef5be4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:37 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3b08513a-2604-4b0d-a2aa-9cdb60715642 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Created volume successfully. Sep 25 21:35:39 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Creating offline snapshot 8563b08a-280b-41cf-9539-6717600366c7 of volume b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da55f3e-bdc0-4662-aec9-46dd4a777f53]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" returned: 0 in 0.430s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:40 devstack quobyte-client[84349]: System call of process 97293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:40 devstack quobyte-client[84349]: System call of process 97293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:40 devstack quobyte-client[84349]: System call of process 97293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:40 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=95, name=volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 1G" returned: 0 in 0.322s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:40 devstack quobyte-client[84349]: System call of process 97302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "qemu-img rebase -u -b volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.247s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.117s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.344s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.195s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.info" returned: 0 in 0.106s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:35:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.info" returned: 0 in 0.089s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dfb4d68e-993c-4e77-a9ec-a72a2f7b264b tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Create snapshot completed successfully Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "cinder-8563b08a-280b-41cf-9539-6717600366c7-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-8563b08a-280b-41cf-9539-6717600366c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "cinder-quobyte-8563b08a-280b-41cf-9539-6717600366c7" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-8563b08a-280b-41cf-9539-6717600366c7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Deleting offline snapshot 8563b08a-280b-41cf-9539-6717600366c7 of volume b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] snapshot_file for this snap is: volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d816e-9d6b-4d6e-9f25-0a188b193f26]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.403s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93be79a-cbe9-418c-adba-b3820799c776]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:44 devstack quobyte-client[84349]: System call of process 97333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:44 devstack quobyte-client[84349]: System call of process 97333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:44 devstack quobyte-client[84349]: System call of process 97333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" returned: 0 in 0.435s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:44 devstack quobyte-client[84349]: System call of process 97336 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.235s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef.8563b08a-280b-41cf-9539-6717600366c7" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-8563b08a-280b-41cf-9539-6717600366c7" released by "_delete_snapshot" :: held 1.495s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" released by "delete_snapshot" :: held 1.518s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Created reservations ['17cf4b9e-5126-4d3c-bfe8-bb75e2105afd', '31f1f555-b015-4a80-b920-1a63d3ba0189', 'b5bac1c4-8a50-4312-a082-e56f0466a1d0', '499f0dc4-c054-4527-8289-bf648e14f90a'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:45 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Delete snapshot completed successfully. Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8112faec-045d-4902-8c6a-0ca35fcec161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-8563b08a-280b-41cf-9539-6717600366c7-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "cinder-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:45 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ded274-8e52-451c-846d-785d12207cb7]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" returned: 0 in 0.421s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" returned: 0 in 0.120s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-quobyte-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef" released by "delete_volume" :: held 0.713s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Created reservations ['c5259300-cd8b-4470-801b-5481ff1f7c35', '440f8c67-fd52-471e-89b7-2decad93d2a2', 'bc287c86-a754-4e56-8773-744bd5809b7d', '7dc136c1-9bb0-4a9b-926b-aa128f5ca903'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:46 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Deleted volume successfully. Sep 25 21:35:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b51db2c4-5f0c-42e0-a0a0-76114c1bf80c tempest-VolumeSnapshotQuotasNegativeTestJSON-1147664949 None] Lock "cinder-b9212cff-3a7e-4d7b-8df5-1e50ce9ef4ef-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:53 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Flow 'volume_create_manager' (c3c761e1-651e-4623-b56a-06a67003f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfa2ed2-9d41-4f80-a2c3-5cf7dd7f3b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfa2ed2-9d41-4f80-a2c3-5cf7dd7f3b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-808139319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dfe148-7172-4596-8bcd-739f8d4d2db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefbdd283765428e8f6178377dd944c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:53Z,use_quota=True,user_id='4806c03ede2144b3be95445ca716ac3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cd95a92-9023-4239-bdc1-f581f4eb177a),volume_type_id=2cd95a92-9023-4239-bdc1-f581f4eb177a)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3892edaf-5051-403e-abed-186b0ff9523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3892edaf-5051-403e-abed-186b0ff9523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea91a93e-d86e-450e-a6d3-419fbf8f4651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea91a93e-d86e-450e-a6d3-419fbf8f4651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dfe148-7172-4596-8bcd-739f8d4d2db7', 'volume_name': 'volume-55dfe148-7172-4596-8bcd-739f8d4d2db7', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2da0210-25d9-4a67-aeb7-8da07584ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2da0210-25d9-4a67-aeb7-8da07584ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe734ec-c2fa-4c0c-b53d-10d3d352b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:53 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Volume 55dfe148-7172-4596-8bcd-739f8d4d2db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dfe148-7172-4596-8bcd-739f8d4d2db7', 'volume_size': 1} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-808139319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dfe148-7172-4596-8bcd-739f8d4d2db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefbdd283765428e8f6178377dd944c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:35:53Z,use_quota=True,user_id='4806c03ede2144b3be95445ca716ac3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cd95a92-9023-4239-bdc1-f581f4eb177a),volume_type_id=2cd95a92-9023-4239-bdc1-f581f4eb177a)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Creating volume 55dfe148-7172-4596-8bcd-739f8d4d2db7 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:35:53 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:53 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=97, name=volume-55dfe148-7172-4596-8bcd-739f8d4d2db7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 1073741824" returned: 0 in 0.319s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7" returned: 0 in 0.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] <== create_volume: return (467ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:35:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe734ec-c2fa-4c0c-b53d-10d3d352b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dfe148-7172-4596-8bcd-739f8d4d2db7', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc62737a-4e67-468e-aaa2-c347d6915e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:35:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Volume volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 (55dfe148-7172-4596-8bcd-739f8d4d2db7): created successfully Sep 25 21:35:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc62737a-4e67-468e-aaa2-c347d6915e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:35:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Flow 'volume_create_manager' (c3c761e1-651e-4623-b56a-06a67003f73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:35:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0bb6c6fc-4a52-4eb6-82b6-11113156d654 tempest-VolumeTypesAccessTest-1952701137 None] Created volume successfully. Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Acquiring lock "cinder-55dfe148-7172-4596-8bcd-739f8d4d2db7-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "cinder-55dfe148-7172-4596-8bcd-739f8d4d2db7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Acquiring lock "cinder-quobyte-55dfe148-7172-4596-8bcd-739f8d4d2db7" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "cinder-quobyte-55dfe148-7172-4596-8bcd-739f8d4d2db7" acquired by "delete_volume" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb817fbc-e4ce-4004-bdce-b0606a920751]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:35:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7" returned: 0 in 0.392s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-55dfe148-7172-4596-8bcd-739f8d4d2db7" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "cinder-quobyte-55dfe148-7172-4596-8bcd-739f8d4d2db7" released by "delete_volume" :: held 0.652s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:35:56 devstack cinder-volume[84334]: WARNING cinder.quota [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-617663970 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-617663970, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:35:56 devstack cinder-volume[84334]: WARNING cinder.quota [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-617663970 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-617663970, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Created reservations ['5e27f1bc-ea7d-4e76-a949-f24ce695e007', 'fc06dcc7-2219-4f77-b160-0b2caec0f5f5', 'b5a983b7-1542-4356-bf25-984f723d5477', 'b6c01470-8962-4b75-b144-38b3fb3cd44d'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:35:56 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:35:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Deleted volume successfully. Sep 25 21:35:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-788d3f1a-f616-4f87-aa77-46fceb83adb8 tempest-VolumeTypesAccessTest-1952701137 None] Lock "cinder-55dfe148-7172-4596-8bcd-739f8d4d2db7-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:36:06 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=25,cinder:DELETE=3,cinder:SELECT=15,cinder:INSERT=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:36:06 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:36:21 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:21 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:36:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Flow 'volume_create_manager' (e3c0bf22-b7c7-4785-8c53-f4e8fa8aaa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:36:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b024741d-8851-4ccb-b918-b84c670bf78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b024741d-8851-4ccb-b918-b84c670bf78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1706387138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e146434-dd60-4f2b-9861-9014841e55be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6b6c5d045a4cbb87742d8d3c23b098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:36:22Z,use_quota=True,user_id='103c02fa5093430ab3cc1099693b26e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4c3a1-a751-4ef9-b86d-274c5caf99ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4c3a1-a751-4ef9-b86d-274c5caf99ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94566cfb-ceb9-4c75-a4f9-348b70f14d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94566cfb-ceb9-4c75-a4f9-348b70f14d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e146434-dd60-4f2b-9861-9014841e55be', 'volume_name': 'volume-0e146434-dd60-4f2b-9861-9014841e55be', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d805651e-d78a-4221-ab6c-ae276efab2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d805651e-d78a-4221-ab6c-ae276efab2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c257d45a-3068-4ab7-80f5-c0ea93fd9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:22 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume 0e146434-dd60-4f2b-9861-9014841e55be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e146434-dd60-4f2b-9861-9014841e55be', 'volume_size': 1} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1706387138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e146434-dd60-4f2b-9861-9014841e55be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6b6c5d045a4cbb87742d8d3c23b098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:36:22Z,use_quota=True,user_id='103c02fa5093430ab3cc1099693b26e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Creating volume 0e146434-dd60-4f2b-9861-9014841e55be {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:36:22 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:22 devstack quobyte-client[84349]: System call of process 97416 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:36:22 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=98, name=volume-0e146434-dd60-4f2b-9861-9014841e55be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be 1073741824" returned: 0 in 0.439s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] <== create_volume: return (636ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:36:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c257d45a-3068-4ab7-80f5-c0ea93fd9673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e146434-dd60-4f2b-9861-9014841e55be', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ade8978-4c32-4538-ad10-9452fd81b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:23 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume volume-0e146434-dd60-4f2b-9861-9014841e55be (0e146434-dd60-4f2b-9861-9014841e55be): created successfully Sep 25 21:36:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ade8978-4c32-4538-ad10-9452fd81b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Flow 'volume_create_manager' (e3c0bf22-b7c7-4785-8c53-f4e8fa8aaa11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:36:23 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e39f5902-b2da-43f1-9816-5f8b7115b515 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Created volume successfully. Sep 25 21:36:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:27 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd3593-679e-428b-afb2-f00cdca8b2c0]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:36:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:28 devstack quobyte-client[84349]: System call of process 97429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:36:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be" returned: 0 in 0.514s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.594s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-0e146434-dd60-4f2b-9861-9014841e55be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9fda727-7e0a-4e28-beb8-e1ef6f23a785', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:36:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:28 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-b3274054-13e2-4a93-a8fa-d1c6cef1a499 req-6a2c263e-7312-4e9a-b1d1-5202570c5466 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] attachment_update completed successfully. Sep 25 21:36:38 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:36:38 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.155s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:36:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (18211119-bff5-477e-9d59-f633795fb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9230b30a-dfae-4c26-b22d-76fda2c5a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9230b30a-dfae-4c26-b22d-76fda2c5a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1498940810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b32eb1-560c-4ab9-b392-ce367c1d23c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:36:56Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933521bb-097f-4a87-a5bb-892280e2ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933521bb-097f-4a87-a5bb-892280e2ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0907e7-b78b-4568-99cc-e1edf6db4679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0907e7-b78b-4568-99cc-e1edf6db4679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b32eb1-560c-4ab9-b392-ce367c1d23c8', 'volume_name': 'volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ff6d5-9b6f-4a09-846c-bffa7edb84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ff6d5-9b6f-4a09-846c-bffa7edb84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070088ad-d6ae-4b89-8352-2b2e60bfe569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:56 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Volume 71b32eb1-560c-4ab9-b392-ce367c1d23c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8', 'volume_size': 1} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1498940810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b32eb1-560c-4ab9-b392-ce367c1d23c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:36:56Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Creating volume 71b32eb1-560c-4ab9-b392-ce367c1d23c8 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:36:56 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:56 devstack quobyte-client[84349]: System call of process 97958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:36:56 devstack quobyte-client[84349]: System call of process 97958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:36:56 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=99, name=volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:36:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 1073741824" returned: 0 in 0.392s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8" returned: 0 in 0.151s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] <== create_volume: return (622ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070088ad-d6ae-4b89-8352-2b2e60bfe569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf0c31-e7a0-456a-ac94-f7c093f022c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:36:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Volume volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 (71b32eb1-560c-4ab9-b392-ce367c1d23c8): created successfully Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf0c31-e7a0-456a-ac94-f7c093f022c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:36:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (18211119-bff5-477e-9d59-f633795fb63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:36:57 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-36f90abe-0e51-4999-a0ed-d55e886e1cce tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:36:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8" by "attach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:36:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8" acquired by "attach_volume" :: waited 0.055s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:36:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Attaching volume 71b32eb1-560c-4ab9-b392-ce367c1d23c8 to instance 245c1c50-55a5-402c-b224-90d23f6b5616 at mountpoint /dev/vdb on host None. Sep 25 21:36:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Attach volume completed successfully. Sep 25 21:36:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cc690df5-0f86-4232-9b9f-7dd87edae2af tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8" released by "attach_volume" :: held 0.314s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:36:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-256182a0-a6e6-4c8b-9d58-f72f48dbed83 req-92d77b11-f313-4464-9031-e5f12e3471d5 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-256182a0-a6e6-4c8b-9d58-f72f48dbed83 req-92d77b11-f313-4464-9031-e5f12e3471d5 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-256182a0-a6e6-4c8b-9d58-f72f48dbed83 req-92d77b11-f313-4464-9031-e5f12e3471d5 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Terminate volume connection completed successfully. Sep 25 21:36:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-256182a0-a6e6-4c8b-9d58-f72f48dbed83 req-92d77b11-f313-4464-9031-e5f12e3471d5 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Deleting attachment b9fda727-7e0a-4e28-beb8-e1ef6f23a785. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:36:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Terminate volume connection completed successfully. Sep 25 21:36:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" by "detach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:36:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:36:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Detaching volume 71b32eb1-560c-4ab9-b392-ce367c1d23c8 from instance 245c1c50-55a5-402c-b224-90d23f6b5616. Sep 25 21:36:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:36:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Detach volume completed successfully. Sep 25 21:36:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-3ba0fa88-c0c0-4c17-ba34-9d5abbaf3e03 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-aa137822-10f2-4e65-8617-71201294215d tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" by "detach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-aa137822-10f2-4e65-8617-71201294215d tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-aa137822-10f2-4e65-8617-71201294215d tempest-VolumesActionsTest-449443064 None] Volume detach called, but volume not attached. Sep 25 21:37:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-aa137822-10f2-4e65-8617-71201294215d tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-quobyte-71b32eb1-560c-4ab9-b392-ce367c1d23c8" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "cinder-0e146434-dd60-4f2b-9861-9014841e55be-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "cinder-quobyte-71b32eb1-560c-4ab9-b392-ce367c1d23c8" acquired by "delete_volume" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "cinder-0e146434-dd60-4f2b-9861-9014841e55be-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b63158-e782-49c8-b8a0-31d088517de0]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "cinder-quobyte-0e146434-dd60-4f2b-9861-9014841e55be" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "cinder-quobyte-0e146434-dd60-4f2b-9861-9014841e55be" acquired by "delete_volume" :: waited 0.061s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547baf7-421c-4629-a6b9-bf3f323878b6]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:02 devstack quobyte-client[84349]: System call of process 97964 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8" returned: 0 in 0.765s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:02 devstack quobyte-client[84349]: System call of process 97965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-71b32eb1-560c-4ab9-b392-ce367c1d23c8" returned: 0 in 0.395s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be" returned: 0 in 0.802s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "cinder-quobyte-71b32eb1-560c-4ab9-b392-ce367c1d23c8" released by "delete_volume" :: held 1.505s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0e146434-dd60-4f2b-9861-9014841e55be" returned: 0 in 0.349s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "cinder-quobyte-0e146434-dd60-4f2b-9861-9014841e55be" released by "delete_volume" :: held 1.246s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Created reservations ['50f652f8-ca03-4178-9476-cfde4a0f3e68', '2f1b8db4-fcf2-4da5-a52d-62686bf61d06', '7d3d86dd-61f0-4547-9980-88bd99a158f3', 'f8d8b4e8-c0c1-4dcc-9914-dd43a56a103e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Created reservations ['ad697b14-b3e0-44a3-98a5-49c82a376c4b', '4a8999de-6492-427f-9762-8a2284f38131', '5dfbe69d-0890-4f8f-9ac2-aada7a58e9f8', '4c8c05f5-bb42-466d-9f84-070d1bd20439'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.431s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:03 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Deleted volume successfully. Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfab2951-dbe3-43cb-9a54-d726d8d8b228 tempest-TestServerVolumeAttachScenarioOldVersion-1627777248 None] Lock "cinder-0e146434-dd60-4f2b-9861-9014841e55be-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.409s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Deleted volume successfully. Sep 25 21:37:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a80bdfa5-f4dc-430f-8ce8-f41274945718 tempest-VolumesActionsTest-449443064 None] Lock "cinder-71b32eb1-560c-4ab9-b392-ce367c1d23c8-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=24,cinder:SELECT=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:37:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (3b27ce34-8348-40bd-904c-80b7a4a64d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ffb360-5b66-41ed-a620-c7950db18db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ffb360-5b66-41ed-a620-c7950db18db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-260043762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27d08c-28d6-49fb-9de5-8b730b4be657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:15Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23579ffa-1f48-4d22-8eaf-5542280648e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23579ffa-1f48-4d22-8eaf-5542280648e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c4bcc9-2e6b-4ebc-add7-3a55b01a16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c4bcc9-2e6b-4ebc-add7-3a55b01a16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de27d08c-28d6-49fb-9de5-8b730b4be657', 'volume_name': 'volume-de27d08c-28d6-49fb-9de5-8b730b4be657', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81480c93-8ad7-4be8-83e5-9c0d5c89ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81480c93-8ad7-4be8-83e5-9c0d5c89ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3688f17-ded5-43a7-bc45-722e4eb6a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:15 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Volume de27d08c-28d6-49fb-9de5-8b730b4be657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de27d08c-28d6-49fb-9de5-8b730b4be657', 'volume_size': 1} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-260043762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27d08c-28d6-49fb-9de5-8b730b4be657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:15Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Creating volume de27d08c-28d6-49fb-9de5-8b730b4be657 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:37:15 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:15 devstack quobyte-client[84349]: System call of process 98070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:15 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=100, name=volume-de27d08c-28d6-49fb-9de5-8b730b4be657, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657 1073741824" returned: 0 in 0.494s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:37:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3688f17-ded5-43a7-bc45-722e4eb6a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de27d08c-28d6-49fb-9de5-8b730b4be657', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f742b3-48e0-46c2-9430-4eaa87689d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:16 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Volume volume-de27d08c-28d6-49fb-9de5-8b730b4be657 (de27d08c-28d6-49fb-9de5-8b730b4be657): created successfully Sep 25 21:37:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f742b3-48e0-46c2-9430-4eaa87689d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (3b27ce34-8348-40bd-904c-80b7a4a64d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-31f64920-8b31-4ea6-981c-8ad04406a1dc tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-de27d08c-28d6-49fb-9de5-8b730b4be657-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-de27d08c-28d6-49fb-9de5-8b730b4be657-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-quobyte-de27d08c-28d6-49fb-9de5-8b730b4be657" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-de27d08c-28d6-49fb-9de5-8b730b4be657" acquired by "delete_volume" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[495ab4b2-a4fe-4db2-aa4b-9e956e645a94]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:18 devstack quobyte-client[84349]: System call of process 98106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657" returned: 0 in 0.801s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de27d08c-28d6-49fb-9de5-8b730b4be657" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-de27d08c-28d6-49fb-9de5-8b730b4be657" released by "delete_volume" :: held 1.127s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Created reservations ['5de036ba-6129-4e50-83be-ac5dd2667871', '4a614941-9eee-4c8c-ab45-c5b38077bf11', 'd16b2270-4d8f-4f08-b1c0-205367455c9f', '9c3ca4d5-cb21-4f73-bc3a-a849a7861172'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.141s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Deleted volume successfully. Sep 25 21:37:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-569ad81c-a4dd-4886-bb4d-e6be5f308743 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-de27d08c-28d6-49fb-9de5-8b730b4be657-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (19146f1c-b953-4cdf-b450-571fb665cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251dd7a3-20d7-4bd3-82e3-e464b75ea951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251dd7a3-20d7-4bd3-82e3-e464b75ea951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003626798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f230522a-9b8b-45e4-8ea6-b82537388387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:21Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5140ab6-262f-4a39-b15c-833ff22e9a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5140ab6-262f-4a39-b15c-833ff22e9a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1f21bb-0aed-4510-899f-ffc28bbd2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1f21bb-0aed-4510-899f-ffc28bbd2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f230522a-9b8b-45e4-8ea6-b82537388387', 'volume_name': 'volume-f230522a-9b8b-45e4-8ea6-b82537388387', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f153fe4-2e70-4add-820d-737bafe3c059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f153fe4-2e70-4add-820d-737bafe3c059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b6458-1614-48c9-956b-beb5ed07aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:20 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Volume f230522a-9b8b-45e4-8ea6-b82537388387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f230522a-9b8b-45e4-8ea6-b82537388387', 'volume_size': 1} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003626798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f230522a-9b8b-45e4-8ea6-b82537388387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:21Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Creating volume f230522a-9b8b-45e4-8ea6-b82537388387 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:37:21 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:21 devstack quobyte-client[84349]: System call of process 98115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:21 devstack quobyte-client[84349]: System call of process 98115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:21 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=101, name=volume-f230522a-9b8b-45e4-8ea6-b82537388387, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387 1073741824" returned: 0 in 0.586s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387" returned: 0 in 0.224s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] <== create_volume: return (960ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:37:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b6458-1614-48c9-956b-beb5ed07aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f230522a-9b8b-45e4-8ea6-b82537388387', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6c238-c022-40d7-9edc-29c7168a5577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:22 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Volume volume-f230522a-9b8b-45e4-8ea6-b82537388387 (f230522a-9b8b-45e4-8ea6-b82537388387): created successfully Sep 25 21:37:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6c238-c022-40d7-9edc-29c7168a5577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (19146f1c-b953-4cdf-b450-571fb665cc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-68b4ceed-dbea-42aa-a4ba-3e61bffdfbe1 tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-f230522a-9b8b-45e4-8ea6-b82537388387-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "cinder-f230522a-9b8b-45e4-8ea6-b82537388387-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-quobyte-f230522a-9b8b-45e4-8ea6-b82537388387" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-f230522a-9b8b-45e4-8ea6-b82537388387" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072a3ef-e921-46b0-ba9b-226b93fd3922]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:24 devstack quobyte-client[84349]: System call of process 98120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:24 devstack quobyte-client[84349]: System call of process 98120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:24 devstack quobyte-client[84349]: System call of process 98120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387" returned: 0 in 0.615s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f230522a-9b8b-45e4-8ea6-b82537388387" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-f230522a-9b8b-45e4-8ea6-b82537388387" released by "delete_volume" :: held 0.991s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Created reservations ['9b4cf02f-8820-4e97-bc78-e23e23f76c26', 'b6b928f4-a2b2-4649-8e04-5b0f1d7c616b', '50fa8aef-d15a-46e5-afa5-cb27623463d5', '9a63ad68-48b0-4bf1-8fd0-a9ed1583a362'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.121s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Deleted volume successfully. Sep 25 21:37:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-155f1f53-30f5-4c43-890f-19df43ec815a tempest-VolumesActionsTest-1566286000 None] Lock "cinder-f230522a-9b8b-45e4-8ea6-b82537388387-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (1378fd0f-1460-4464-bac8-0bf9a74f6de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae39c83-0fc3-4f63-b811-7f191216d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae39c83-0fc3-4f63-b811-7f191216d769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1165158244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83366641-5494-4ab7-a812-ed307560f0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:26Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925779ed-02b8-4fc2-889a-0b44bd2c85ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925779ed-02b8-4fc2-889a-0b44bd2c85ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2410ab-a6a8-458c-9f66-3736e2df98a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2410ab-a6a8-458c-9f66-3736e2df98a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83366641-5494-4ab7-a812-ed307560f0ac', 'volume_name': 'volume-83366641-5494-4ab7-a812-ed307560f0ac', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a7846c-83f1-4575-8bc8-a5486ca2d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a7846c-83f1-4575-8bc8-a5486ca2d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d5f1fb-55a4-4fd7-a4d6-f62a7454a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Volume 83366641-5494-4ab7-a812-ed307560f0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83366641-5494-4ab7-a812-ed307560f0ac', 'volume_size': 1} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1165158244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83366641-5494-4ab7-a812-ed307560f0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:26Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Creating volume 83366641-5494-4ab7-a812-ed307560f0ac {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:37:26 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:37:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:26 devstack quobyte-client[84349]: System call of process 98126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:26 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=102, name=volume-83366641-5494-4ab7-a812-ed307560f0ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac 1073741824" returned: 0 in 0.412s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac" returned: 0 in 0.107s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d5f1fb-55a4-4fd7-a4d6-f62a7454a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83366641-5494-4ab7-a812-ed307560f0ac', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d751680e-5403-4059-81aa-e1e6d131dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:27 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Volume volume-83366641-5494-4ab7-a812-ed307560f0ac (83366641-5494-4ab7-a812-ed307560f0ac): created successfully Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d751680e-5403-4059-81aa-e1e6d131dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (1378fd0f-1460-4464-bac8-0bf9a74f6de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:27 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4106f487-139e-42b7-b535-71b0c4735152 tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:37:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-83366641-5494-4ab7-a812-ed307560f0ac-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-83366641-5494-4ab7-a812-ed307560f0ac-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-quobyte-83366641-5494-4ab7-a812-ed307560f0ac" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-83366641-5494-4ab7-a812-ed307560f0ac" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54fdaab-9821-4549-be73-e7842a92495e]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:29 devstack quobyte-client[84349]: System call of process 98131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:29 devstack quobyte-client[84349]: System call of process 98131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac" returned: 0 in 0.482s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-83366641-5494-4ab7-a812-ed307560f0ac" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-83366641-5494-4ab7-a812-ed307560f0ac" released by "delete_volume" :: held 0.759s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Created reservations ['e85d7bd5-bdac-4fa4-bbf1-9020a38899cd', '580e756d-bd9d-453f-97cd-46c27a2b27fc', '6fa0f410-16ff-413a-b03a-a36167646bd6', '4033e42f-297d-491d-bc20-c684a10afbde'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.130s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Deleted volume successfully. Sep 25 21:37:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ce44b411-0f50-4a90-9012-7a3772603fe5 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-83366641-5494-4ab7-a812-ed307560f0ac-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (fda27344-32b9-4775-b47b-5487d6848c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d421e875-f33c-484b-8330-2eedff501de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d421e875-f33c-484b-8330-2eedff501de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354950201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d49b627-9fe1-48b2-ab14-5fe22c1f8535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:32Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31381357-b713-4c89-8768-b252e1bb0f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31381357-b713-4c89-8768-b252e1bb0f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7912aea-26b2-4afc-a9e7-2df75d080e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7912aea-26b2-4afc-a9e7-2df75d080e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d49b627-9fe1-48b2-ab14-5fe22c1f8535', 'volume_name': 'volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fcbd80-b813-40c4-9d31-c99f46ea637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fcbd80-b813-40c4-9d31-c99f46ea637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ddcd3-32d7-4fd0-8fd2-f45e59d969ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:31 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Volume 1d49b627-9fe1-48b2-ab14-5fe22c1f8535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535', 'volume_size': 1} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354950201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d49b627-9fe1-48b2-ab14-5fe22c1f8535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:32Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Creating volume 1d49b627-9fe1-48b2-ab14-5fe22c1f8535 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:37:31 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:37:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:32 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=103, name=volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 1073741824" returned: 0 in 0.355s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" returned: 0 in 0.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] <== create_volume: return (546ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ddcd3-32d7-4fd0-8fd2-f45e59d969ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3540ab8b-175d-4dc0-a875-f6ec9628ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:32 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Volume volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 (1d49b627-9fe1-48b2-ab14-5fe22c1f8535): created successfully Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3540ab8b-175d-4dc0-a875-f6ec9628ff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (fda27344-32b9-4775-b47b-5487d6848c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-598e9a6e-2085-42e2-964f-b4fc38577744 tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-1d49b627-9fe1-48b2-ab14-5fe22c1f8535-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-1d49b627-9fe1-48b2-ab14-5fe22c1f8535-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "cinder-quobyte-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f6250-4176-4e73-be88-19b6b5ba68db]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" returned: 0 in 0.437s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-quobyte-1d49b627-9fe1-48b2-ab14-5fe22c1f8535" released by "delete_volume" :: held 0.736s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Created reservations ['f4956b0f-0424-495e-b753-e9e1a3ae3586', '74aae871-c344-4208-addb-becb272797b4', 'c40b6015-49b6-43c2-8023-b0d018281ed6', 'e23b51f2-e1d4-4d3a-87b0-2f8b1e0536b0'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.128s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Deleted volume successfully. Sep 25 21:37:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-323f7d80-5c53-4594-b3c2-1bfbef4886b9 tempest-VolumesActionsTest-1566286000 None] Lock "cinder-1d49b627-9fe1-48b2-ab14-5fe22c1f8535-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (f2f572c6-2731-4b0d-806e-aee5d3a22ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c23fc16-c32a-4861-809b-1392a779e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c23fc16-c32a-4861-809b-1392a779e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189807018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de317613-506a-4ea7-bf6b-69405c32e2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:37Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db60837-24e1-44e4-8846-023b2d9fb4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db60837-24e1-44e4-8846-023b2d9fb4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8683a8b7-34bf-4af9-a884-7c31f41418a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8683a8b7-34bf-4af9-a884-7c31f41418a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de317613-506a-4ea7-bf6b-69405c32e2d1', 'volume_name': 'volume-de317613-506a-4ea7-bf6b-69405c32e2d1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0d568f-733e-433a-85bc-ce5c80d3f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0d568f-733e-433a-85bc-ce5c80d3f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb3a79a-3c38-4334-8d53-c36578622217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:37 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Volume de317613-506a-4ea7-bf6b-69405c32e2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de317613-506a-4ea7-bf6b-69405c32e2d1', 'volume_size': 1} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189807018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de317613-506a-4ea7-bf6b-69405c32e2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667ba3f72c8479cbb02ecf6be491e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:37:37Z,use_quota=True,user_id='4be81937c5ea415197fe85d8d9791226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Creating volume de317613-506a-4ea7-bf6b-69405c32e2d1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:37:37 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:37 devstack quobyte-client[84349]: System call of process 98149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:37:37 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=104, name=volume-de317613-506a-4ea7-bf6b-69405c32e2d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1 1073741824" returned: 0 in 0.381s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:37:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.566s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb3a79a-3c38-4334-8d53-c36578622217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de317613-506a-4ea7-bf6b-69405c32e2d1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf664505-5d37-44c2-87e5-c7f173ddd631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:37:38 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Volume volume-de317613-506a-4ea7-bf6b-69405c32e2d1 (de317613-506a-4ea7-bf6b-69405c32e2d1): created successfully Sep 25 21:37:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf664505-5d37-44c2-87e5-c7f173ddd631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:37:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Flow 'volume_create_manager' (f2f572c6-2731-4b0d-806e-aee5d3a22ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:37:38 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0d3db4f4-84ff-4335-82a4-c4707b70a49d tempest-VolumesActionsTest-449443064 None] Created volume successfully. Sep 25 21:37:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-de317613-506a-4ea7-bf6b-69405c32e2d1-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "cinder-de317613-506a-4ea7-bf6b-69405c32e2d1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Acquiring lock "cinder-quobyte-de317613-506a-4ea7-bf6b-69405c32e2d1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "cinder-quobyte-de317613-506a-4ea7-bf6b-69405c32e2d1" acquired by "delete_volume" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d60cc-d43c-4f45-b132-5496a8e4bedd]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.216s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1" returned: 0 in 0.621s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-de317613-506a-4ea7-bf6b-69405c32e2d1" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "cinder-quobyte-de317613-506a-4ea7-bf6b-69405c32e2d1" released by "delete_volume" :: held 0.971s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Created reservations ['638e6aa1-b974-402a-ab2e-58e4ac1f6a44', '7e9a2f5e-66ac-43cc-acf4-29cd89b8af04', 'd75bc4f4-4a5a-4550-8deb-166c34f71011', '1ae0f546-1d70-47b0-b1fc-5d1587933afa'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.117s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:37:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:37:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Deleted volume successfully. Sep 25 21:37:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a83b03ec-770e-4064-bd95-d8ef27d3af41 tempest-VolumesActionsTest-449443064 None] Lock "cinder-de317613-506a-4ea7-bf6b-69405c32e2d1-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:37:51 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=31,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:37:52 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=50,cinder:UPDATE=68,cinder:DELETE=8,cinder:INSERT=16 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:38:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Flow 'volume_create_manager' (3d741562-09d3-424e-a525-3a6d5f6eefe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e651c5-67d3-4397-a81e-dfa5458646fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e651c5-67d3-4397-a81e-dfa5458646fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267052625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb92a54-5fe5-43ae-b2b2-3d4cd106f454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa681488fc94331b04f5364dc4f74d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:02Z,use_quota=True,user_id='7176f4576fca4c37a360bb87069f34fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846c655-128a-43f6-a813-e37a9cf02f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846c655-128a-43f6-a813-e37a9cf02f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39faa3ac-087f-423e-8fd6-8f94c2e3d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39faa3ac-087f-423e-8fd6-8f94c2e3d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'volume_name': 'volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdc0b26-68c7-4c4b-b7cb-3f4d4546b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdc0b26-68c7-4c4b-b7cb-3f4d4546b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cea0ca6-a6ed-43ed-a531-1d10dc07c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Cloning 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b at location (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:38:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (2fdc1a8c-35bf-420d-9918-f721c981e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f984db0-1a1d-49e2-a409-7cda0ccf530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f984db0-1a1d-49e2-a409-7cda0ccf530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1536268562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc68487-cea8-4a93-a720-669c9c7dfeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154cb481ad541ec8bd0cba5e7c5cd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:03Z,use_quota=True,user_id='769a57cfc8ff4c30837a81fee7c96f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e6c88c-fbeb-4db9-aa69-a9d493bb81f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e6c88c-fbeb-4db9-aa69-a9d493bb81f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d709dc9-8ec4-402b-aad4-043ce44bc07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d709dc9-8ec4-402b-aad4-043ce44bc07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc68487-cea8-4a93-a720-669c9c7dfeae', 'volume_name': 'volume-bdc68487-cea8-4a93-a720-669c9c7dfeae', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220a1913-6ce9-4dfd-a5ea-0e9b20ebc431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220a1913-6ce9-4dfd-a5ea-0e9b20ebc431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c77d51e-2727-4c4c-a93e-e2bdc3641f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Volume bdc68487-cea8-4a93-a720-669c9c7dfeae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc68487-cea8-4a93-a720-669c9c7dfeae', 'volume_size': 1} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1536268562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc68487-cea8-4a93-a720-669c9c7dfeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154cb481ad541ec8bd0cba5e7c5cd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:03Z,use_quota=True,user_id='769a57cfc8ff4c30837a81fee7c96f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Creating volume bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:03 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:03 devstack quobyte-client[84349]: System call of process 98171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:03 devstack quobyte-client[84349]: System call of process 98171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:03 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=105, name=volume-bdc68487-cea8-4a93-a720-669c9c7dfeae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae 1073741824" returned: 0 in 0.398s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c77d51e-2727-4c4c-a93e-e2bdc3641f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc68487-cea8-4a93-a720-669c9c7dfeae', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100224c7-6e57-455b-b1df-45d279e1888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:03 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD, size 20.69 MB, duration 1.03 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:38:03 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Image download 20.69 MB at 20.18 MB/s Sep 25 21:38:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Volume volume-bdc68487-cea8-4a93-a720-669c9c7dfeae (bdc68487-cea8-4a93-a720-669c9c7dfeae): created successfully Sep 25 21:38:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100224c7-6e57-455b-b1df-45d279e1888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (2fdc1a8c-35bf-420d-9918-f721c981e353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5704c5aa-1dd2-4b80-9ee6-d713106aa591 tempest-VolumesDeleteCascade-27860707 None] Created volume successfully. Sep 25 21:38:04 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e17d971-ee5e-41d9-b303-0b2c4e29c295]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:04 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD Sep 25 21:38:04 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Creating offline snapshot 3617173a-33de-49dd-8696-42693dd6b447 of volume bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:38:05 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f958a0-c664-42a2-8b88-56ce135a57f3]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:06 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:06 devstack quobyte-client[84349]: System call of process 98181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:06 devstack quobyte-client[84349]: System call of process 98181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD" returned: 0 in 2.269s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b is fetched for user 7176f4576fca4c37a360bb87069f34fa. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae" returned: 0 in 0.804s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:06 devstack quobyte-client[84349]: System call of process 98185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:06 devstack quobyte-client[84349]: System call of process 98185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:06 devstack quobyte-client[84349]: System call of process 98185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:06 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=106, name=volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 1G" returned: 0 in 0.391s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdc68487-cea8-4a93-a720-669c9c7dfeae -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack quobyte-client[84349]: System call of process 98188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img rebase -u -b volume-bdc68487-cea8-4a93-a720-669c9c7dfeae -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.205s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd0637-b130-475d-936c-bd36e9bbea40]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.205s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.info" returned: 0 in 0.122s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:07 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD Sep 25 21:38:07 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.info" returned: 0 in 0.096s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-247c15e0-be2d-4b2d-afdd-aa5687d347b7 tempest-VolumesDeleteCascade-27860707 None] Create snapshot completed successfully Sep 25 21:38:08 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Creating offline snapshot 13156151-e440-4ebe-a2a7-394d1815cc5c of volume bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713275e-464c-422c-8c23-7d9c2bcf5d20]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:09 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:09 devstack quobyte-client[84349]: System call of process 98200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:09 devstack quobyte-client[84349]: System call of process 98200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:09 devstack quobyte-client[84349]: System call of process 98200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD" returned: 0 in 2.373s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.690s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc68487-cea8-4a93-a720-669c9c7dfeae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:09 devstack quobyte-client[84349]: System call of process 98203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=108, name=volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c 1G" returned: 0 in 0.309s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img rebase -u -b volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.145s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.083s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.631s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267052625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb92a54-5fe5-43ae-b2b2-3d4cd106f454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa681488fc94331b04f5364dc4f74d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:02Z,use_quota=True,user_id='7176f4576fca4c37a360bb87069f34fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Creating volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:10 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:38:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:10 devstack quobyte-client[84349]: System call of process 98211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:10 devstack quobyte-client[84349]: System call of process 98211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=109, name=volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-19b8de4b-0500-4a94-b838-1c6b2634743c tempest-VolumesDeleteCascade-27860707 None] Create snapshot completed successfully Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 1073741824" returned: 0 in 0.431s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] <== create_volume: return (600ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.631s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Attempting download of 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9acae8-1f96-401d-aeb5-67c4d54fe83f]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_qxgkv6wc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_qxgkv6wc" returned: 0 in 0.344s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_qxgkv6wc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-bdc68487-cea8-4a93-a720-669c9c7dfeae-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-bdc68487-cea8-4a93-a720-669c9c7dfeae-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_qxgkv6wc" returned: 1 in 0.554s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_qxgkv6wc' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b0f60a-93c0-416f-ae5f-fbb2bb068470]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Performing cascade delete. {{(pid=84334) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-13156151-e440-4ebe-a2a7-394d1815cc5c-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-13156151-e440-4ebe-a2a7-394d1815cc5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b was qcow2, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:13 devstack quobyte-client[84349]: System call of process 98222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:13 devstack quobyte-client[84349]: System call of process 98222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:13 devstack quobyte-client[84349]: System call of process 98222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:13 devstack quobyte-client[84349]: System call of process 98222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:13 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=109, name=volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" acquired by "delete_snapshot" :: waited 0.231s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-13156151-e440-4ebe-a2a7-394d1815cc5c" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-13156151-e440-4ebe-a2a7-394d1815cc5c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Deleting offline snapshot 13156151-e440-4ebe-a2a7-394d1815cc5c of volume bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] snapshot_file for this snap is: volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa89533-0304-4633-b028-25aec31ddbd8]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.460s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc68487-cea8-4a93-a720-669c9c7dfeae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a6556-75d3-4bb9-98e3-2a747af78dc3]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 1.073s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_ge05prbldevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:38:14 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Converted 112.00 MB image at 100.72 MB/s Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:14 devstack quobyte-client[84349]: System call of process 98236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:14 devstack quobyte-client[84349]: System call of process 98236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:14 devstack quobyte-client[84349]: System call of process 98236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 1G" returned: 0 in 0.217s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.579s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc68487-cea8-4a93-a720-669c9c7dfeae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb311ee-27e4-4a87-9202-09a9ea1787ad]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:14 devstack quobyte-client[84349]: System call of process 98241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.481s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:15 devstack quobyte-client[84349]: System call of process 98243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.495s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.13156151-e440-4ebe-a2a7-394d1815cc5c" returned: 0 in 0.193s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-13156151-e440-4ebe-a2a7-394d1815cc5c" released by "_delete_snapshot" :: held 2.101s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" released by "delete_snapshot" :: held 2.205s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:15 devstack quobyte-client[84349]: System call of process 98247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 1 in 0.544s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Downloaded image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b for user 7176f4576fca4c37a360bb87069f34fa is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Marking volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Copying metadata from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b to 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Creating volume glance metadata for volume 7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 backed by image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:38:15 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Created reservations ['4f8f7f5c-efcc-47f7-a70f-f3ea440df75d', '26e5b8ee-3ad2-46cf-ad47-93bfbde83a0d', '05cf0be2-932f-4786-8a94-0c70877b3d29', '28eb086f-79de-4efc-a6a1-d7f9c79c9ff1'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cea0ca6-a6ed-43ed-a531-1d10dc07c558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75678f0f-5b9f-482e-966a-3965639411c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:16 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Volume volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 (7fb92a54-5fe5-43ae-b2b2-3d4cd106f454): created successfully Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75678f0f-5b9f-482e-966a-3965639411c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Flow 'volume_create_manager' (3d741562-09d3-424e-a525-3a6d5f6eefe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Delete snapshot completed successfully. Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-13156151-e440-4ebe-a2a7-394d1815cc5c-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-3617173a-33de-49dd-8696-42693dd6b447-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58278042-3db4-4fab-b904-75d8013b7d4d tempest-TestShelveInstance-1417225085 None] Created volume successfully. Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-3617173a-33de-49dd-8696-42693dd6b447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-3617173a-33de-49dd-8696-42693dd6b447" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3617173a-33de-49dd-8696-42693dd6b447" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Deleting offline snapshot 3617173a-33de-49dd-8696-42693dd6b447 of volume bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] snapshot_file for this snap is: volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab6aa2-4862-44c1-9708-94cc7bcd31b2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.376s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc68487-cea8-4a93-a720-669c9c7dfeae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5331e-d973-4806-bd27-7f3d36992508]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae" returned: 0 in 0.435s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:17 devstack quobyte-client[84349]: System call of process 98256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.227s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae.3617173a-33de-49dd-8696-42693dd6b447" returned: 0 in 0.180s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3617173a-33de-49dd-8696-42693dd6b447" released by "_delete_snapshot" :: held 1.637s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" released by "delete_snapshot" :: held 1.660s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Created reservations ['6cbae435-0c63-4540-9d0f-28870e145bf4', 'dc5125d0-2aa3-4bb4-86c2-5595e2c73e3b', '093d9400-813b-4f68-bb8d-d5214b291557', '0427b23a-88ab-49b9-802c-3521cf129339'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Delete snapshot completed successfully. Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-3617173a-33de-49dd-8696-42693dd6b447-delete_snapshot" released by "delete_snapshot" :: held 2.337s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Snapshots deleted, issuing volume delete {{(pid=84334) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" acquired by "delete_volume" :: waited 0.023s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90e21a-1554-4185-afb1-5d0b94445deb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:19 devstack quobyte-client[84349]: System call of process 98290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae" returned: 0 in 0.555s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bdc68487-cea8-4a93-a720-669c9c7dfeae" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-bdc68487-cea8-4a93-a720-669c9c7dfeae" released by "delete_volume" :: held 0.878s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Created reservations ['cd4e8050-7e6a-4b0c-a193-6d48d5e04279', '1ef96462-91b6-4573-b0a9-2ec0b76dd4e0', '30a9a6ee-45dd-4af2-a8a0-9c9f87a67690', '6f14c0ea-60e5-4e9a-bf67-c264906d0e21'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.120s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:38:20 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Deleted volume successfully. Sep 25 21:38:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-2543834c-26b2-4304-adb2-834292732f40 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-bdc68487-cea8-4a93-a720-669c9c7dfeae-delete_volume" released by "delete_volume" :: held 7.889s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:20 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (61d417b6-be30-4d60-bc4f-b387b12d467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3b7efb-ebca-4ef9-8aa9-d48960e7e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3b7efb-ebca-4ef9-8aa9-d48960e7e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-888050946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9621d55-56c8-4814-bbc8-0b75acc6e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154cb481ad541ec8bd0cba5e7c5cd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:21Z,use_quota=True,user_id='769a57cfc8ff4c30837a81fee7c96f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b9dc18-9db3-4acc-a75a-cf8b50403646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b9dc18-9db3-4acc-a75a-cf8b50403646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce70d283-5a4b-4805-96e8-a9471caf6ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce70d283-5a4b-4805-96e8-a9471caf6ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9621d55-56c8-4814-bbc8-0b75acc6e934', 'volume_name': 'volume-a9621d55-56c8-4814-bbc8-0b75acc6e934', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03e907e-7d5a-4b1c-ad25-4da4cd7ebbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03e907e-7d5a-4b1c-ad25-4da4cd7ebbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88471cc6-a779-4cc2-a5d1-ae3109834612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:21 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Volume a9621d55-56c8-4814-bbc8-0b75acc6e934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9621d55-56c8-4814-bbc8-0b75acc6e934', 'volume_size': 1} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-888050946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9621d55-56c8-4814-bbc8-0b75acc6e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154cb481ad541ec8bd0cba5e7c5cd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:21Z,use_quota=True,user_id='769a57cfc8ff4c30837a81fee7c96f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Creating volume a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:21 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:21 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=110, name=volume-a9621d55-56c8-4814-bbc8-0b75acc6e934, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 1073741824" returned: 0 in 0.533s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.225s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] <== create_volume: return (852ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:38:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88471cc6-a779-4cc2-a5d1-ae3109834612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9621d55-56c8-4814-bbc8-0b75acc6e934', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78b0db-8d19-45f4-b856-7577786f06dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:22 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Volume volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 (a9621d55-56c8-4814-bbc8-0b75acc6e934): created successfully Sep 25 21:38:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78b0db-8d19-45f4-b856-7577786f06dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (61d417b6-be30-4d60-bc4f-b387b12d467d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f963eb5e-f2fd-4cad-9ce4-ac4b0f16c5c1 tempest-VolumesDeleteCascade-27860707 None] Created volume successfully. Sep 25 21:38:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Creating offline snapshot 3a57911d-762c-4d1d-9989-49846614ef81 of volume a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c3980-a924-4baa-a40c-2f98fbaa4736]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.490s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:24 devstack quobyte-client[84349]: System call of process 98306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:24 devstack quobyte-client[84349]: System call of process 98306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:24 devstack quobyte-client[84349]: System call of process 98306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:24 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=111, name=volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 1G" returned: 0 in 0.329s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img rebase -u -b volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.167s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.148s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.154s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.info" returned: 0 in 0.100s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.info" returned: 0 in 0.120s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4e0119a5-a561-4bef-a2a4-5b0d0248a4f7 tempest-VolumesDeleteCascade-27860707 None] Create snapshot completed successfully Sep 25 21:38:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:26 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e925bc-123d-4791-83bc-c7642862ff28]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:27 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.919s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (bd136a84-7476-49e1-a09f-0d75f3126068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb6d0ac-d5b2-4ec5-97ad-4e217dd8a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:28 devstack quobyte-client[84349]: System call of process 98328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb6d0ac-d5b2-4ec5-97ad-4e217dd8a600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2086019410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373a26c0-2870-4558-870c-3f71f661dfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154cb481ad541ec8bd0cba5e7c5cd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a57911d-762c-4d1d-9989-49846614ef81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:27Z,use_quota=True,user_id='769a57cfc8ff4c30837a81fee7c96f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00841f13-e482-40da-88ca-7dcc645307f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00841f13-e482-40da-88ca-7dcc645307f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1620f4-bff4-4c6c-bc01-2e06eff8d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1620f4-bff4-4c6c-bc01-2e06eff8d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '373a26c0-2870-4558-870c-3f71f661dfb5', 'volume_name': 'volume-373a26c0-2870-4558-870c-3f71f661dfb5', 'volume_size': 1, 'snapshot_id': '3a57911d-762c-4d1d-9989-49846614ef81'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b0b083-a77a-42be-b41b-6e2133eb0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b0b083-a77a-42be-b41b-6e2133eb0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e3b0c-1834-4759-b56a-b2aa2a436752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:28 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Volume 373a26c0-2870-4558-870c-3f71f661dfb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-373a26c0-2870-4558-870c-3f71f661dfb5', 'volume_size': 1, 'snapshot_id': '3a57911d-762c-4d1d-9989-49846614ef81'} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 1 in 0.629s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.613s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81-373a26c0-2870-4558-870c-3f71f661dfb5" by "_create_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81-373a26c0-2870-4558-870c-3f71f661dfb5" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Creating volume 373a26c0-2870-4558-870c-3f71f661dfb5 from snapshot 3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" by "_copy_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] snapshot: 3a57911d-762c-4d1d-9989-49846614ef81, volume: 373a26c0-2870-4558-870c-3f71f661dfb5, {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9b0d48c-29de-4dc8-bdc2-b3ecea2f3547', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:38:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4748ba98-628c-48f5-bd12-61592b19b129]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.522s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9621d55-56c8-4814-bbc8-0b75acc6e934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Creating direct copy from snapshot {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9e413-6add-42b9-8431-b731ff7a75b8]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-aae484f8-e351-4b4a-8565-01f6d3ab718d req-a0d24d68-a8cf-4874-8fde-9ac9eb373bff tempest-TestShelveInstance-1417225085 None] attachment_update completed successfully. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.621s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG cinder.utils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 not found in is_blk_device check {{(pid=84334) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 25 21:38:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: System call of process 98337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:29 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=113, name=volume-373a26c0-2870-4558-870c-3f71f661dfb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5" returned: 0 in 5.432s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b812570-31ba-43da-b07f-b6d44115bf96]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.598s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:38:35 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Converted 1024.00 MB image at 187.58 MB/s Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:38:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5" returned: 0 in 0.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" released by "_copy_volume_from_snapshot" :: held 7.627s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81-373a26c0-2870-4558-870c-3f71f661dfb5" released by "_create_volume_from_snapshot" :: held 7.695s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.756s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e3b0c-1834-4759-b56a-b2aa2a436752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373a26c0-2870-4558-870c-3f71f661dfb5', 'volume_size': 1, 'snapshot_id': '3a57911d-762c-4d1d-9989-49846614ef81'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7574cb87-05b0-4471-ab52-2e1117edde3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:36 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Volume volume-373a26c0-2870-4558-870c-3f71f661dfb5 (373a26c0-2870-4558-870c-3f71f661dfb5): created successfully Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7574cb87-05b0-4471-ab52-2e1117edde3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Flow 'volume_create_manager' (bd136a84-7476-49e1-a09f-0d75f3126068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ff457e1a-7957-4f6d-b8a0-679c60dd8f63 tempest-VolumesDeleteCascade-27860707 None] Created volume successfully. Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-a9621d55-56c8-4814-bbc8-0b75acc6e934-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-a9621d55-56c8-4814-bbc8-0b75acc6e934-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Performing cascade delete. {{(pid=84334) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-3a57911d-762c-4d1d-9989-49846614ef81-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-3a57911d-762c-4d1d-9989-49846614ef81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Deleting offline snapshot 3a57911d-762c-4d1d-9989-49846614ef81 of volume a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] snapshot_file for this snap is: volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a60ec-690b-46ea-aa06-699952c19d8d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:38 devstack quobyte-client[84349]: System call of process 98753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.461s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9621d55-56c8-4814-bbc8-0b75acc6e934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:38:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d0c69-f795-4511-a0a2-1fb4cda8bdf1]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.746s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:39 devstack quobyte-client[84349]: System call of process 98779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.642s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934.3a57911d-762c-4d1d-9989-49846614ef81" returned: 0 in 0.825s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-3a57911d-762c-4d1d-9989-49846614ef81" released by "_delete_snapshot" :: held 3.240s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.414s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" released by "delete_snapshot" :: held 3.293s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:38:41 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Created reservations ['20c4468a-6b03-4df4-88c9-8a41deaa02c9', 'eeee1ce5-f5dd-4775-b518-32b4ad123465', '193c1a6e-3b8c-4406-88ed-0067e14b3186', 'aa54bd73-b84d-48c4-a9c7-b119c4725950'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Delete snapshot completed successfully. Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-3a57911d-762c-4d1d-9989-49846614ef81-delete_snapshot" released by "delete_snapshot" :: held 4.179s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Snapshots deleted, issuing volume delete {{(pid=84334) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" acquired by "delete_volume" :: waited 0.027s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc67e1-6a64-41de-91e8-74d6bc2a6b27]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.654s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a9621d55-56c8-4814-bbc8-0b75acc6e934" returned: 0 in 0.174s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-a9621d55-56c8-4814-bbc8-0b75acc6e934" released by "delete_volume" :: held 1.174s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Created reservations ['6e8dec80-61ba-4468-8bc5-ea70813796d4', '933abd51-c9cf-4a64-8a3e-6a55e987380a', '68db0657-a2f9-427e-acb0-d95eda784ed6', 'd7ab4cdd-1dde-4ebb-91a9-6246af6fd3ad'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:43 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:38:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Deleted volume successfully. Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-01abcbb3-f229-417b-b29d-4747f5dd4b0b tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-a9621d55-56c8-4814-bbc8-0b75acc6e934-delete_volume" released by "delete_volume" :: held 6.511s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-373a26c0-2870-4558-870c-3f71f661dfb5-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-373a26c0-2870-4558-870c-3f71f661dfb5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:44 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5426c061-21cb-465a-afeb-585e7693ece0]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5" returned: 0 in 0.385s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-373a26c0-2870-4558-870c-3f71f661dfb5" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-quobyte-373a26c0-2870-4558-870c-3f71f661dfb5" released by "delete_volume" :: held 0.667s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Created reservations ['3ef00bb4-9f89-4fd6-adda-9bed2ce77808', '352fc322-759f-4174-8781-3c7ead50db2c', 'a3b28386-f368-4452-914c-62effc38f5b3', '8900e3e2-5f1d-45f3-911a-6dbfdd3f48a6'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:45 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.237s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:46 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:38:46 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Deleted volume successfully. Sep 25 21:38:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7bc39b7c-a1e8-49a2-9b83-a0b242714f35 tempest-VolumesDeleteCascade-27860707 None] Lock "cinder-373a26c0-2870-4558-870c-3f71f661dfb5-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:51 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Flow 'volume_create_manager' (dc7b7284-31b4-4567-8d0b-2c8849da138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2208f5-ab0d-46af-9ff0-8b9f98e433b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2208f5-ab0d-46af-9ff0-8b9f98e433b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1568483177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad620677-2594-4ece-bf5c-a28771014895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae65629dcf425b8bfc60eb9191c5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:52Z,use_quota=True,user_id='481c482c80454f4bb6247cca26922068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6508258-17bb-4add-b0ec-611e02084feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6508258-17bb-4add-b0ec-611e02084feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50092ad-d5c1-4ef6-bb68-e43f9fcaf135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50092ad-d5c1-4ef6-bb68-e43f9fcaf135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad620677-2594-4ece-bf5c-a28771014895', 'volume_name': 'volume-ad620677-2594-4ece-bf5c-a28771014895', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f876fa-c435-490d-9bc5-471722615b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f876fa-c435-490d-9bc5-471722615b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9890c4c-e32e-4d65-b25d-27181fda22d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Volume ad620677-2594-4ece-bf5c-a28771014895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad620677-2594-4ece-bf5c-a28771014895', 'volume_size': 1} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1568483177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad620677-2594-4ece-bf5c-a28771014895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae65629dcf425b8bfc60eb9191c5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:52Z,use_quota=True,user_id='481c482c80454f4bb6247cca26922068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Creating volume ad620677-2594-4ece-bf5c-a28771014895 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:52 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:52 devstack quobyte-client[84349]: System call of process 98847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:52 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=114, name=volume-ad620677-2594-4ece-bf5c-a28771014895, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895 1073741824" returned: 0 in 0.436s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895" returned: 0 in 0.219s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] <== create_volume: return (776ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9890c4c-e32e-4d65-b25d-27181fda22d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad620677-2594-4ece-bf5c-a28771014895', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb4706d-d988-4e0d-99db-b2163ed24005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:53 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Volume volume-ad620677-2594-4ece-bf5c-a28771014895 (ad620677-2594-4ece-bf5c-a28771014895): created successfully Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb4706d-d988-4e0d-99db-b2163ed24005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:53 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Flow 'volume_create_manager' (dc7b7284-31b4-4567-8d0b-2c8849da138e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:53 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-6f6e47df-853b-48b9-a761-653513f52525 tempest-VolumesTransfersTest-518791606 None] Created volume successfully. Sep 25 21:38:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3f166de5-e7b1-4eb5-8fc8-f7d3e6516625 tempest-VolumesTransfersTest-219306767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3f166de5-e7b1-4eb5-8fc8-f7d3e6516625 tempest-VolumesTransfersTest-219306767 None] Transfer volume completed successfully. Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "cinder-ad620677-2594-4ece-bf5c-a28771014895-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-ad620677-2594-4ece-bf5c-a28771014895-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "cinder-quobyte-ad620677-2594-4ece-bf5c-a28771014895" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-quobyte-ad620677-2594-4ece-bf5c-a28771014895" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7372f3-fbd0-440a-bfdc-72cb15613332]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:38:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:57 devstack quobyte-client[84349]: System call of process 98876 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895" returned: 0 in 0.620s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ad620677-2594-4ece-bf5c-a28771014895" returned: 0 in 0.283s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-quobyte-ad620677-2594-4ece-bf5c-a28771014895" released by "delete_volume" :: held 1.069s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Created reservations ['39acb97e-12f7-4b28-bc09-934364713f17', '128cc2c3-e63a-4851-81f2-2a483cbc5b0c', '6a445c91-8c53-4ce3-a837-796a189470fe', '3a4e1280-9cc5-482c-898e-999cee536067'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:38:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Deleted volume successfully. Sep 25 21:38:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-575a6f47-148d-4bbb-b1c6-63117886f073 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-ad620677-2594-4ece-bf5c-a28771014895-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:38:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Flow 'volume_create_manager' (e7b75147-362d-400a-8e1e-15015533ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eaf82e-50bb-4b14-a587-c6a94d466d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eaf82e-50bb-4b14-a587-c6a94d466d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015387017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183886f7-b7e3-4a32-9c59-68b0a95d5a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae65629dcf425b8bfc60eb9191c5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:59Z,use_quota=True,user_id='481c482c80454f4bb6247cca26922068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806f1f6d-d07e-4d28-881b-2d562faa1175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806f1f6d-d07e-4d28-881b-2d562faa1175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3318-4907-40b7-b286-0c721c7841f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3318-4907-40b7-b286-0c721c7841f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183886f7-b7e3-4a32-9c59-68b0a95d5a9e', 'volume_name': 'volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7b6a08-f095-46fa-a5b7-1a302b40fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7b6a08-f095-46fa-a5b7-1a302b40fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c917009c-049b-4809-8bf7-3e5a2dfd5b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:38:59 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Volume 183886f7-b7e3-4a32-9c59-68b0a95d5a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e', 'volume_size': 1} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015387017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183886f7-b7e3-4a32-9c59-68b0a95d5a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ae65629dcf425b8bfc60eb9191c5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:38:59Z,use_quota=True,user_id='481c482c80454f4bb6247cca26922068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Creating volume 183886f7-b7e3-4a32-9c59-68b0a95d5a9e {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:38:59 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:38:59 devstack quobyte-client[84349]: System call of process 98881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:59 devstack quobyte-client[84349]: System call of process 98881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:38:59 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=115, name=volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e 1073741824" returned: 0 in 0.416s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:38:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" returned: 0 in 0.182s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] <== create_volume: return (668ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c917009c-049b-4809-8bf7-3e5a2dfd5b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a238f5-7e6e-4ebc-aa67-61b3f374d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Volume volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e (183886f7-b7e3-4a32-9c59-68b0a95d5a9e): created successfully Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a238f5-7e6e-4ebc-aa67-61b3f374d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Flow 'volume_create_manager' (e7b75147-362d-400a-8e1e-15015533ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:39:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58fbbe7c-e0d2-41c9-ab1f-59e8f5f32e22 tempest-VolumesTransfersTest-518791606 None] Created volume successfully. Sep 25 21:39:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "cinder-183886f7-b7e3-4a32-9c59-68b0a95d5a9e-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:39:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-183886f7-b7e3-4a32-9c59-68b0a95d5a9e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=59,cinder:UPDATE=75,cinder:INSERT=20,cinder:DELETE=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "cinder-quobyte-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-quobyte-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f1882-cab5-408c-90f1-fe97906fafd1]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" returned: 0 in 0.478s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-quobyte-183886f7-b7e3-4a32-9c59-68b0a95d5a9e" released by "delete_volume" :: held 0.748s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=67,cinder:UPDATE=59,cinder:DELETE=7,cinder:INSERT=21 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Created reservations ['caffd43c-bb96-4151-8109-de82512f42ca', '2b6d8dae-e475-4e67-90a1-fb84af33bdb2', 'e0d38810-58d8-4a58-8810-9060659505cb', '872004a4-1d73-4c9f-93e1-e015c4824e2b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:39:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Deleted volume successfully. Sep 25 21:39:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8dba06f7-b38b-48b2-bda8-15dc66f60e49 tempest-VolumesTransfersTest-132311481 None] Lock "cinder-183886f7-b7e3-4a32-9c59-68b0a95d5a9e-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:39:13 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=12 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:13 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Flow 'volume_create_manager' (2073790a-ebe4-4154-955d-1a751639ee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7550a61e-a468-404c-bf8e-aec8c9af0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7550a61e-a468-404c-bf8e-aec8c9af0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30431901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e7c619-f439-4880-b988-ef3a99abd19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17316e68129f4776ade13d7053be7f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:39:20Z,use_quota=True,user_id='fe2d9c07057a466f8cb7ef3e2dfc5570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e65bec8-1b52-4fdc-b923-f7101093d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e65bec8-1b52-4fdc-b923-f7101093d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0c792-4b6c-4af4-97dd-bae9b2716049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0c792-4b6c-4af4-97dd-bae9b2716049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e7c619-f439-4880-b988-ef3a99abd19b', 'volume_name': 'volume-d9e7c619-f439-4880-b988-ef3a99abd19b', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a4b9ce-c2eb-4037-b440-3c65dad4db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a4b9ce-c2eb-4037-b440-3c65dad4db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41e9cb9-80a6-45eb-aadb-7e5c6ba9aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:20 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Volume d9e7c619-f439-4880-b988-ef3a99abd19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e7c619-f439-4880-b988-ef3a99abd19b', 'volume_size': 1} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30431901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e7c619-f439-4880-b988-ef3a99abd19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17316e68129f4776ade13d7053be7f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:39:20Z,use_quota=True,user_id='fe2d9c07057a466f8cb7ef3e2dfc5570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Creating volume d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:39:20 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:20 devstack quobyte-client[84349]: System call of process 98946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:39:20 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=116, name=volume-d9e7c619-f439-4880-b988-ef3a99abd19b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b 1073741824" returned: 0 in 0.370s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.140s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41e9cb9-80a6-45eb-aadb-7e5c6ba9aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e7c619-f439-4880-b988-ef3a99abd19b', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0472f1b5-7099-4b43-ac1d-316b2eab5857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:39:21 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Volume volume-d9e7c619-f439-4880-b988-ef3a99abd19b (d9e7c619-f439-4880-b988-ef3a99abd19b): created successfully Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0472f1b5-7099-4b43-ac1d-316b2eab5857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:39:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Flow 'volume_create_manager' (2073790a-ebe4-4154-955d-1a751639ee75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:39:21 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-347a0a6a-1d24-4aaf-8119-eed528942669 tempest-VolumesActionsTest-1325097707 None] Created volume successfully. Sep 25 21:39:31 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:31 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:39:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:39:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.395s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:39:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:39:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" by "attach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:39:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" acquired by "attach_volume" :: waited 0.035s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:39:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:39:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Attaching volume d9e7c619-f439-4880-b988-ef3a99abd19b to instance 31f75c66-2fbf-4c70-9f83-b5760a48bdb7 at mountpoint /dev/vdb on host None. Sep 25 21:39:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Attach volume completed successfully. Sep 25 21:39:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7486bea0-9f36-45a1-804a-bd6cdfb41995 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" released by "attach_volume" :: held 0.348s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:39:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" by "detach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:39:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:39:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:39:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Detaching volume d9e7c619-f439-4880-b988-ef3a99abd19b from instance 31f75c66-2fbf-4c70-9f83-b5760a48bdb7. Sep 25 21:39:49 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:39:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Detach volume completed successfully. Sep 25 21:39:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-497e49a8-3f28-405e-a401-55e0712b21a4 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:39:59 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:39:59 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5ac7d615-2a6a-456a-964e-8ac991484d19 req-f7d050e9-5eb2-4b58-9529-a40c15e80a9f tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-5ac7d615-2a6a-456a-964e-8ac991484d19 req-f7d050e9-5eb2-4b58-9529-a40c15e80a9f tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-5ac7d615-2a6a-456a-964e-8ac991484d19 req-f7d050e9-5eb2-4b58-9529-a40c15e80a9f tempest-TestShelveInstance-1417225085 None] Terminate volume connection completed successfully. Sep 25 21:40:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-5ac7d615-2a6a-456a-964e-8ac991484d19 req-f7d050e9-5eb2-4b58-9529-a40c15e80a9f tempest-TestShelveInstance-1417225085 None] Deleting attachment d9b0d48c-29de-4dc8-bdc2-b3ecea2f3547. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ca224-d5d7-4a3d-9fbd-25571b3a323c]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.427s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 1 in 0.510s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:40:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.107s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:40:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60e3c642-5730-473f-a54c-266fa24978e0', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:40:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-687c9d40-14ed-4962-8f35-cf0d86d6c769 req-8628437c-4b78-451c-a664-73fe081a03ef tempest-TestShelveInstance-1417225085 None] attachment_update completed successfully. Sep 25 21:40:23 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:23 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=8 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" by "attach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:40:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" acquired by "attach_volume" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:40:24 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Attaching volume d9e7c619-f439-4880-b988-ef3a99abd19b to instance 46569e64-e697-44d3-8d9d-feebf714b6df at mountpoint /dev/vdb on host None. Sep 25 21:40:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Attach volume completed successfully. Sep 25 21:40:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-db3d9e8a-7b48-407c-8e3a-5d9b8ce4b2ef tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b" released by "attach_volume" :: held 0.204s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:40:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" by "detach_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:40:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:40:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Detaching volume d9e7c619-f439-4880-b988-ef3a99abd19b from instance 46569e64-e697-44d3-8d9d-feebf714b6df. Sep 25 21:40:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Detach volume completed successfully. Sep 25 21:40:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c2ba78f2-ddde-41c9-9a7c-2c7899ef7670 tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:40:35 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:INSERT=2,cinder:UPDATE=3,cinder:SELECT=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:35 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:40:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:40:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:40:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe19e41-758a-4e65-99e4-64c2ff6fa694]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:40:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:39 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc102c-93c3-4d01-8a92-ec6d1b69d99b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:40:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:39 devstack quobyte-client[84349]: System call of process 99897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:40:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.443s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.f4ae81e3-9edf-43e3-ae3a-e182d2402165xhrms9zk.img {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:39 devstack quobyte-client[84349]: System call of process 99900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:40:39 devstack quobyte-client[84349]: System call of process 99900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:40:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.092s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.261s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.500s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.f4ae81e3-9edf-43e3-ae3a-e182d2402165xhrms9zk.img" returned: 0 in 6.311s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd092c29-402c-48c7-8317-9a0f8ce579a9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.567s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.f4ae81e3-9edf-43e3-ae3a-e182d2402165xhrms9zk.img {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:40:46 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Converted 1024.00 MB image at 161.95 MB/s Sep 25 21:40:46 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] f4ae81e3-9edf-43e3-ae3a-e182d2402165 was raw, no need to convert to raw {{(pid=84334) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1128}} Sep 25 21:40:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:40:56 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:41:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.162s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Uploaded volume to glance image-id: f4ae81e3-9edf-43e3-ae3a-e182d2402165. {{(pid=84334) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 25 21:41:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-637df1b5-14a6-4b27-bef3-903bb4b52dc2 tempest-VolumesActionsTest-1325097707 None] Copy volume to image completed successfully. Sep 25 21:41:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f8d7d8-6ebc-456f-840b-c25fdc2ceecb]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:24 devstack quobyte-client[84349]: System call of process 100001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.435s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:24 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[94149a71-afe3-4402-82f2-4a46d677abd0]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.495s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img" returned: 0 in 6.482s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:31 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2309df1-f1c7-45f5-9ba6-e8af7a4a2f85]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.680s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:41:32 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Converted 1024.00 MB image at 157.34 MB/s Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] e29c9e12-416f-4cd6-b420-5e928f6cf755 was raw, converting to qcow2 {{(pid=84334) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab5974-1ae9-4098-8bee-5bb8dfc34ce3]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img" returned: 0 in 0.401s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img" returned: 1 in 0.373s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:41:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img /opt/stack/data/cinder/conversion/vol_upload_alv3sexj {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img /opt/stack/data/cinder/conversion/vol_upload_alv3sexj" returned: 0 in 1.573s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:34 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Image conversion details: src /opt/stack/data/cinder/conversion/d9e7c619-f439-4880-b988-ef3a99abd19b.temp_image.e29c9e12-416f-4cd6-b420-5e928f6cf755y_p_mfpi.img, size 1024.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/conversion/vol_upload_alv3sexj {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:41:34 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Converted 1024.00 MB image at 635.05 MB/s Sep 25 21:41:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f9db0-86f9-414f-b8ae-c7f72c627183]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_alv3sexj {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_alv3sexj" returned: 0 in 0.376s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.822s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Uploaded volume to glance image-id: e29c9e12-416f-4cd6-b420-5e928f6cf755. {{(pid=84334) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 25 21:41:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-58c7a997-a1c6-497f-a245-494668fef6fb tempest-VolumesActionsTest-1325097707 None] Copy volume to image completed successfully. Sep 25 21:41:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Acquiring lock "cinder-quobyte-d9e7c619-f439-4880-b988-ef3a99abd19b" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "cinder-quobyte-d9e7c619-f439-4880-b988-ef3a99abd19b" acquired by "delete_volume" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758b317-be5d-47f4-a60f-9817fdf28e90]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.470s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-d9e7c619-f439-4880-b988-ef3a99abd19b" returned: 0 in 0.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "cinder-quobyte-d9e7c619-f439-4880-b988-ef3a99abd19b" released by "delete_volume" :: held 0.769s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Created reservations ['12fc2eed-e2ee-4c6e-8a8e-7e3e54d23033', 'df5ff000-9a1e-4e2f-9c2d-8df0e7d226c0', '37d0d9d9-3757-4cc7-8434-1c96f306c596', '65bbfadd-6fd7-4c8f-8144-aa97aa122f13'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.087s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:41:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Deleted volume successfully. Sep 25 21:41:39 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c0eb7a37-2642-4021-82cb-707eb10b924f tempest-VolumesActionsTest-1325097707 None] Lock "cinder-d9e7c619-f439-4880-b988-ef3a99abd19b-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:41:49 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:41:49 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:41:50 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:50 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:41:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Flow 'volume_create_manager' (ef3c82e5-6930-46c7-8a72-9ac387bed353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:41:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d1d4ad-4d4a-4982-89c4-b1213e7e4878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d1d4ad-4d4a-4982-89c4-b1213e7e4878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2100242083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b9e42d-6c91-4d23-85f1-bb035f4d894b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c83826507ea40ce88b14e8b1ae871a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:41:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:41:51Z,use_quota=True,user_id='261c65b8777b4fac87b2d3b062223b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c17398-61db-403c-ae0e-38048a7e356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c17398-61db-403c-ae0e-38048a7e356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d927c173-e790-4713-ae42-bfe37347ca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d927c173-e790-4713-ae42-bfe37347ca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b9e42d-6c91-4d23-85f1-bb035f4d894b', 'volume_name': 'volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b', 'volume_size': 2}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65aaef8f-c9a6-4777-b9a8-c73a3512e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65aaef8f-c9a6-4777-b9a8-c73a3512e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e39bee5-0ee3-4345-bb47-50dd3a98d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:51 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Volume 20b9e42d-6c91-4d23-85f1-bb035f4d894b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b', 'volume_size': 2} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2100242083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b9e42d-6c91-4d23-85f1-bb035f4d894b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c83826507ea40ce88b14e8b1ae871a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:41:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:41:51Z,use_quota=True,user_id='261c65b8777b4fac87b2d3b062223b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Creating volume 20b9e42d-6c91-4d23-85f1-bb035f4d894b {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:41:51 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b 2147483648 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:51 devstack quobyte-client[84349]: System call of process 100119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:51 devstack quobyte-client[84349]: System call of process 100119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:51 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=117, name=volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:41:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-fb47e39c-f1d1-4f0e-a2e4-fd917360d382 tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b 2147483648" returned: 0 in 0.620s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-fb47e39c-f1d1-4f0e-a2e4-fd917360d382 tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:51 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-fb47e39c-f1d1-4f0e-a2e4-fd917360d382 tempest-TestShelveInstance-1417225085 None] Terminate volume connection completed successfully. Sep 25 21:41:51 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-fb47e39c-f1d1-4f0e-a2e4-fd917360d382 tempest-TestShelveInstance-1417225085 None] Deleting attachment 60e3c642-5730-473f-a54c-266fa24978e0. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b" returned: 0 in 0.296s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] <== create_volume: return (939ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e39bee5-0ee3-4345-bb47-50dd3a98d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b', 'volume_size': 2}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd0b468-7bc8-4ed8-87f8-62e48a23b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:41:52 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Volume volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b (20b9e42d-6c91-4d23-85f1-bb035f4d894b): created successfully Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd0b468-7bc8-4ed8-87f8-62e48a23b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Flow 'volume_create_manager' (ef3c82e5-6930-46c7-8a72-9ac387bed353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:41:52 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bf4b0d43-16bf-4410-ad45-b5dff69d0a3d tempest-VolumesCloneNegativeTest-441391079 None] Created volume successfully. Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Acquiring lock "cinder-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "cinder-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Acquiring lock "cinder-quobyte-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "cinder-quobyte-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e80379b-3f0f-4fed-8392-d823268827cf]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:53 devstack quobyte-client[84349]: System call of process 100123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Acquiring lock "cinder-20b9e42d-6c91-4d23-85f1-bb035f4d894b-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.717s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "cinder-20b9e42d-6c91-4d23-85f1-bb035f4d894b-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Acquiring lock "cinder-quobyte-20b9e42d-6c91-4d23-85f1-bb035f4d894b" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:41:54 devstack quobyte-client[84349]: System call of process 100125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "cinder-quobyte-20b9e42d-6c91-4d23-85f1-bb035f4d894b" acquired by "delete_volume" :: waited 0.067s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 1 in 0.604s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a048c206-80d0-45d4-b05f-a5f19e7caf9e]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" returned: 0 in 0.190s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "cinder-quobyte-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454" released by "delete_volume" :: held 1.926s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:41:54 devstack cinder-volume[84334]: DEBUG cinder.quota [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Created reservations ['940c06f6-1d03-4499-9083-bb38c9f37f61', '1390eede-1e03-4e53-b5f8-30412c80b89c', '7c4f6d6b-95c5-44b3-9248-88af8f21fa74', '8a150b17-f8e3-4373-b7b4-a9c123ca4966'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:54 devstack quobyte-client[84349]: System call of process 100132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b" returned: 0 in 0.635s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-20b9e42d-6c91-4d23-85f1-bb035f4d894b" returned: 0 in 0.260s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "cinder-quobyte-20b9e42d-6c91-4d23-85f1-bb035f4d894b" released by "delete_volume" :: held 1.164s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Created reservations ['9dc1351a-54fc-4a47-8c7b-93185dc5d3aa', 'd6dc5274-8961-42e9-9d72-6fcf829e7a3b', '9f243a91-c6af-4529-8215-24a66cbb2ee9', '2b668c12-ae4c-4ff8-a2ec-63a50f71d999'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.368s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:55 devstack cinder-volume[84334]: DEBUG cinder.manager [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:41:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Deleted volume successfully. Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [req-d66ed9cb-b83a-44ba-be10-51d010286a90 req-f554bb0e-3cbc-41c7-a98a-34cd6b7e9504 tempest-TestShelveInstance-1417225085 None] Lock "cinder-7fb92a54-5fe5-43ae-b2b2-3d4cd106f454-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:41:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Deleted volume successfully. Sep 25 21:41:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d8edf6f6-0f3f-4029-bafb-eab7004018d2 tempest-VolumesCloneNegativeTest-441391079 None] Lock "cinder-20b9e42d-6c91-4d23-85f1-bb035f4d894b-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:00 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:42:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Flow 'volume_create_manager' (2e909ac2-fdd0-46ad-87a9-7c1165cefcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387a20c3-ac6d-4c39-b688-c26b28631fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387a20c3-ac6d-4c39-b688-c26b28631fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1516697365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19faf585-3db6-40b9-9e74-771990443671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845857458ef464494b01bbc81e76b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:01Z,use_quota=True,user_id='2cd0833141c642ed81050fce7f65aa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90377f90-e592-4f0d-8612-f8f9c0a44be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90377f90-e592-4f0d-8612-f8f9c0a44be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9bd264-24a8-4150-957e-1e91923775b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9bd264-24a8-4150-957e-1e91923775b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19faf585-3db6-40b9-9e74-771990443671', 'volume_name': 'volume-19faf585-3db6-40b9-9e74-771990443671', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2986af-7ddd-4fc5-b5ab-e18a18897d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2986af-7ddd-4fc5-b5ab-e18a18897d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5763a085-6aa3-457c-81a7-32fad65c24eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Volume 19faf585-3db6-40b9-9e74-771990443671: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19faf585-3db6-40b9-9e74-771990443671', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Cloning 19faf585-3db6-40b9-9e74-771990443671 from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b at location (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:42:01 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc39bb-54a3-4fed-a8f5-c14e0d3d8a34]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:02 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD Sep 25 21:42:02 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:04 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD" returned: 0 in 2.206s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:04 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b is fetched for user 2cd0833141c642ed81050fce7f65aa4f. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:42:04 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc87d08-bf02-4f6b-9317-23dc80c69069]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:04 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD Sep 25 21:42:04 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:07 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD" returned: 0 in 2.592s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1516697365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19faf585-3db6-40b9-9e74-771990443671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845857458ef464494b01bbc81e76b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:01Z,use_quota=True,user_id='2cd0833141c642ed81050fce7f65aa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Creating volume 19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:42:07 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:07 devstack quobyte-client[84349]: System call of process 100153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:07 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=118, name=volume-19faf585-3db6-40b9-9e74-771990443671, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 1073741824" returned: 0 in 0.479s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 0.147s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:42:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:08 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Attempting download of 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 19faf585-3db6-40b9-9e74-771990443671. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:42:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f161b92-bb4b-4d71-83c5-1520fbef4079]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_1c5y2q3x {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_1c5y2q3x" returned: 0 in 0.415s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_1c5y2q3x {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_1c5y2q3x" returned: 1 in 0.400s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_1c5y2q3x' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73d7d0-601f-442c-9afb-156689b42ef3]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b was qcow2, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:42:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:10 devstack quobyte-client[84349]: System call of process 100165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:10 devstack quobyte-client[84349]: System call of process 100165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=118, name=volume-19faf585-3db6-40b9-9e74-771990443671, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 1.033s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:10 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b_solspn8ydevstack@QuobyteHD, size 112.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:42:10 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Converted 112.00 MB image at 104.96 MB/s Sep 25 21:42:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 1G" returned: 0 in 0.156s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:11 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef9cf6-5fe5-4b0d-812b-da01d890019e]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:11 devstack quobyte-client[84349]: System call of process 100173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 0.466s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:12 devstack quobyte-client[84349]: System call of process 100175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 1 in 0.451s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Downloaded image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b ((None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}])) to volume 19faf585-3db6-40b9-9e74-771990443671 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Temporary image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b for user 2cd0833141c642ed81050fce7f65aa4f is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Marking volume 19faf585-3db6-40b9-9e74-771990443671 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Copying metadata from image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b to 19faf585-3db6-40b9-9e74-771990443671. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Creating volume glance metadata for volume 19faf585-3db6-40b9-9e74-771990443671 backed by image 766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5763a085-6aa3-457c-81a7-32fad65c24eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19faf585-3db6-40b9-9e74-771990443671', 'volume_size': 1, 'image_id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3fe569e2acd6474b939e54d352038d5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b', 'created_at': datetime.datetime(2025, 9, 25, 19, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/766ddc2d-bbdf-4b8b-b8b9-8121f1f8707b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82df04b-ac4d-4ba5-bb0a-053c1412a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Volume volume-19faf585-3db6-40b9-9e74-771990443671 (19faf585-3db6-40b9-9e74-771990443671): created successfully Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82df04b-ac4d-4ba5-bb0a-053c1412a925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Flow 'volume_create_manager' (2e909ac2-fdd0-46ad-87a9-7c1165cefcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-38ca1948-cddd-44e7-80fe-a5ae78e4c909 tempest-VolumesExtendTest-1576859054 None] Created volume successfully. Sep 25 21:42:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[69baa878-8b08-4d51-87dc-d3821b5c7273]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:14 devstack quobyte-client[84349]: System call of process 100179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 0.553s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 1 in 0.433s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:42:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 2G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 2G" returned: 0 in 0.175s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.334s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:15 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f10e453e-633b-495c-a344-fab7b290c422 tempest-VolumesExtendTest-1576859054 None] Extend volume completed successfully. Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-19faf585-3db6-40b9-9e74-771990443671-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-19faf585-3db6-40b9-9e74-771990443671-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:16 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-quobyte-19faf585-3db6-40b9-9e74-771990443671" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-19faf585-3db6-40b9-9e74-771990443671" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b52cc2-ac80-47b4-a93c-5bdcbc4f1839]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:17 devstack quobyte-client[84349]: System call of process 100187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 0.468s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 1 in 0.460s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-19faf585-3db6-40b9-9e74-771990443671" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-19faf585-3db6-40b9-9e74-771990443671" released by "delete_volume" :: held 1.322s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Created reservations ['118f01e8-3d75-4594-a60b-5c167d9df734', 'db4a0e77-c1ab-4a39-979a-b2cf6384d5b3', 'e17eb3fe-4f11-4d8c-8d75-3027685d8966', '47826ed4-98dd-450d-9a1c-86c0cdb89cfc'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.122s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:18 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:42:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Deleted volume successfully. Sep 25 21:42:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a7f924f7-e5ed-4006-9bd9-39d4b5caec38 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-19faf585-3db6-40b9-9e74-771990443671-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:19 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:19 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:42:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Flow 'volume_create_manager' (069d4cd8-0a18-404a-b787-c497f4825735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b161183-54c5-48f1-9050-8fe537cf14e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b161183-54c5-48f1-9050-8fe537cf14e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1880241278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc75569-dbff-4296-83ee-adbfd93d4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845857458ef464494b01bbc81e76b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:20Z,use_quota=True,user_id='2cd0833141c642ed81050fce7f65aa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b3222-3e34-4e2d-914b-7be58699e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b3222-3e34-4e2d-914b-7be58699e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf9f37-ec52-4e56-ae08-cbb2c60bc771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf9f37-ec52-4e56-ae08-cbb2c60bc771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc75569-dbff-4296-83ee-adbfd93d4730', 'volume_name': 'volume-7dc75569-dbff-4296-83ee-adbfd93d4730', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b96cfef-4321-44b0-8151-b497ae91f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b96cfef-4321-44b0-8151-b497ae91f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e2be0d-1d86-420b-a7e7-8d1128352fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:20 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Volume 7dc75569-dbff-4296-83ee-adbfd93d4730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc75569-dbff-4296-83ee-adbfd93d4730', 'volume_size': 1} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1880241278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc75569-dbff-4296-83ee-adbfd93d4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845857458ef464494b01bbc81e76b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:20Z,use_quota=True,user_id='2cd0833141c642ed81050fce7f65aa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Creating volume 7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:42:20 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:20 devstack quobyte-client[84349]: System call of process 100194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:20 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=119, name=volume-7dc75569-dbff-4296-83ee-adbfd93d4730, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 1073741824" returned: 0 in 0.436s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.164s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:42:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e2be0d-1d86-420b-a7e7-8d1128352fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc75569-dbff-4296-83ee-adbfd93d4730', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b27d14-f1f5-4dc3-b3ae-965930347b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:21 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Volume volume-7dc75569-dbff-4296-83ee-adbfd93d4730 (7dc75569-dbff-4296-83ee-adbfd93d4730): created successfully Sep 25 21:42:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b27d14-f1f5-4dc3-b3ae-965930347b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Flow 'volume_create_manager' (069d4cd8-0a18-404a-b787-c497f4825735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:21 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9b2aa37e-fbd1-48b4-8699-4c21c7fd5b81 tempest-VolumesExtendTest-1576859054 None] Created volume successfully. Sep 25 21:42:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Creating offline snapshot 1186eb65-6ab7-4fd2-8373-59a2e22c716d of volume 7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:42:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080b905-d3b2-402a-9da6-7df087b266a6]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.898s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack quobyte-client[84349]: System call of process 100233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:23 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=120, name=volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d 1G" returned: 0 in 0.318s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7dc75569-dbff-4296-83ee-adbfd93d4730 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img rebase -u -b volume-7dc75569-dbff-4296-83ee-adbfd93d4730 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.180s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.091s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.info" returned: 0 in 0.117s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.info" returned: 0 in 0.095s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-148f4061-e275-44fa-9064-05a0f841ead2 tempest-VolumesExtendTest-1576859054 None] Create snapshot completed successfully Sep 25 21:42:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd13829-4376-4312-b1b4-1d9feb04b384]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.608s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d 2G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d 2G" returned: 0 in 0.293s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.034s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:27 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-253ca7d1-bb26-469d-bdc9-9bad8a8bdc8a tempest-VolumesExtendTest-1576859054 None] Extend volume completed successfully. Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-1186eb65-6ab7-4fd2-8373-59a2e22c716d-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-1186eb65-6ab7-4fd2-8373-59a2e22c716d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-quobyte-1186eb65-6ab7-4fd2-8373-59a2e22c716d" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-1186eb65-6ab7-4fd2-8373-59a2e22c716d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Deleting offline snapshot 1186eb65-6ab7-4fd2-8373-59a2e22c716d of volume 7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] snapshot_file for this snap is: volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4918d241-c6a6-4dff-a27a-f268016a3d2d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.466s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dc75569-dbff-4296-83ee-adbfd93d4730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[27147692-f73d-4ee9-9a4c-fdc0f3d80b22]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.515s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:29 devstack quobyte-client[84349]: System call of process 100258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:29 devstack quobyte-client[84349]: System call of process 100258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:29 devstack quobyte-client[84349]: System call of process 100258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.295s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730.1186eb65-6ab7-4fd2-8373-59a2e22c716d" returned: 0 in 0.096s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-1186eb65-6ab7-4fd2-8373-59a2e22c716d" released by "_delete_snapshot" :: held 1.802s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" released by "delete_snapshot" :: held 1.835s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:30 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Created reservations ['d4a5843c-1156-4b15-b77d-6ea7f4a8e17e', 'd2290e0f-a261-4c67-bb98-b573596b779d', '6492d85a-ef83-41eb-97f5-717303ed72a9', '482ad715-bf72-493a-972a-07c8e31d533f'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Delete snapshot completed successfully. Sep 25 21:42:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bcf201ca-c682-40c4-95c4-7598e1c4b79d tempest-VolumesExtendTest-1576859054 None] Lock "cinder-1186eb65-6ab7-4fd2-8373-59a2e22c716d-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-7dc75569-dbff-4296-83ee-adbfd93d4730-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-7dc75569-dbff-4296-83ee-adbfd93d4730-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" acquired by "delete_volume" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f93ab2-8a4f-42c5-8ad9-ad90f6cc31ef]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.564s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-7dc75569-dbff-4296-83ee-adbfd93d4730" returned: 0 in 0.140s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-quobyte-7dc75569-dbff-4296-83ee-adbfd93d4730" released by "delete_volume" :: held 0.945s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Created reservations ['fb7e09ae-8b95-476c-8a9c-a55abf2120bb', '7bb95a6e-6bee-4c94-9010-c37068c2fb82', 'a57cd47a-00f3-404d-9424-91d553d05857', 'e6c912a1-0ac5-4fc5-a82a-d253be634f6e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.128s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:42:33 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Deleted volume successfully. Sep 25 21:42:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5cc696bb-3d67-4f7e-8028-d4dae04b13e7 tempest-VolumesExtendTest-1576859054 None] Lock "cinder-7dc75569-dbff-4296-83ee-adbfd93d4730-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:35 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Flow 'volume_create_manager' (7e7bb11c-61ac-41de-b03e-7f734096a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc351124-6cb8-408e-835b-d20e281e51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc351124-6cb8-408e-835b-d20e281e51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1873465465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a6b55c-3102-404d-b348-f9d43b31e9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3e4519c2474a89b7738b3e2395c506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:35Z,use_quota=True,user_id='d8d987665db4416ba2f1f5951283f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b05180-ed2f-4166-998c-824388c0925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b05180-ed2f-4166-998c-824388c0925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db74891e-bd48-4292-838b-a3afe8376335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db74891e-bd48-4292-838b-a3afe8376335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a6b55c-3102-404d-b348-f9d43b31e9e0', 'volume_name': 'volume-68a6b55c-3102-404d-b348-f9d43b31e9e0', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce48cfa-a797-4300-b119-0e56b8f8caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce48cfa-a797-4300-b119-0e56b8f8caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323c83ed-5d7b-48fa-8745-1c8711a20868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:35 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Volume 68a6b55c-3102-404d-b348-f9d43b31e9e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a6b55c-3102-404d-b348-f9d43b31e9e0', 'volume_size': 1} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1873465465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a6b55c-3102-404d-b348-f9d43b31e9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3e4519c2474a89b7738b3e2395c506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:35Z,use_quota=True,user_id='d8d987665db4416ba2f1f5951283f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Creating volume 68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:42:35 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:35 devstack quobyte-client[84349]: System call of process 100270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:35 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=122, name=volume-68a6b55c-3102-404d-b348-f9d43b31e9e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 1073741824" returned: 0 in 0.383s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.141s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:42:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323c83ed-5d7b-48fa-8745-1c8711a20868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a6b55c-3102-404d-b348-f9d43b31e9e0', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e705ab7d-061b-4951-94e4-12c92245db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:36 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Volume volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 (68a6b55c-3102-404d-b348-f9d43b31e9e0): created successfully Sep 25 21:42:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e705ab7d-061b-4951-94e4-12c92245db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:36 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Flow 'volume_create_manager' (7e7bb11c-61ac-41de-b03e-7f734096a820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2234df11-40fc-494e-86ba-4d1677700d13 tempest-SnapshotDependencyTests-1311580292 None] Created volume successfully. Sep 25 21:42:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Creating offline snapshot 3065c891-498a-41ef-85d9-6d811a745922 of volume 68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:42:37 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ad0b7-a682-406c-9da6-935f24231eb1]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:38 devstack quobyte-client[84349]: System call of process 100274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.446s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:38 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=123, name=volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 1G" returned: 0 in 0.311s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:38 devstack quobyte-client[84349]: System call of process 100280 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "qemu-img rebase -u -b volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.153s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.107s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.info" returned: 0 in 0.103s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.info" returned: 0 in 0.126s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:39 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-6c65c227-b5ba-4851-94c7-cf5f23714e43 tempest-SnapshotDependencyTests-1311580292 None] Create snapshot completed successfully Sep 25 21:42:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Flow 'volume_create_manager' (c8d25d39-b019-425c-bed7-cd7dccb208a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46704fd7-7155-4bf6-89b3-37b657e90332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46704fd7-7155-4bf6-89b3-37b657e90332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-118893910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e46269-1c05-465c-8f22-acd86520d862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dfbd9bb0dc455ebe8fd4d7c9ee76a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:40Z,use_quota=True,user_id='3764c6db959b4e90bd61c45d5afde3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8889f9c-518a-4dfa-9187-e9d9eae06692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8889f9c-518a-4dfa-9187-e9d9eae06692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee040679-eac8-4af5-b268-4bf45fb51d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee040679-eac8-4af5-b268-4bf45fb51d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e46269-1c05-465c-8f22-acd86520d862', 'volume_name': 'volume-98e46269-1c05-465c-8f22-acd86520d862', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e2f56-8a5f-4193-a227-4cbd35e178d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e2f56-8a5f-4193-a227-4cbd35e178d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24d12e5-2dfe-4be9-976e-184537b58e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:40 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume 98e46269-1c05-465c-8f22-acd86520d862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e46269-1c05-465c-8f22-acd86520d862', 'volume_size': 1} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-118893910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e46269-1c05-465c-8f22-acd86520d862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dfbd9bb0dc455ebe8fd4d7c9ee76a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:40Z,use_quota=True,user_id='3764c6db959b4e90bd61c45d5afde3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Creating volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:42:40 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:40 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=125, name=volume-98e46269-1c05-465c-8f22-acd86520d862, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 1073741824" returned: 0 in 0.422s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.293s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862" returned: 0 in 0.259s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24d12e5-2dfe-4be9-976e-184537b58e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e46269-1c05-465c-8f22-acd86520d862', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d64f786-95ec-4d3f-9bea-93d61d611546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume volume-98e46269-1c05-465c-8f22-acd86520d862 (98e46269-1c05-465c-8f22-acd86520d862): created successfully Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d64f786-95ec-4d3f-9bea-93d61d611546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Flow 'volume_create_manager' (c8d25d39-b019-425c-bed7-cd7dccb208a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e0eb1fab-5134-4cfe-a226-67ab27c7e341 tempest-VolumesSnapshotListTestJSON-1615347806 None] Created volume successfully. Sep 25 21:42:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Flow 'volume_create_manager' (fa23b624-379a-4a2e-a8b0-55fc5db52993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb33f91a-64b3-4bed-9369-d12b2a7ec9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb33f91a-64b3-4bed-9369-d12b2a7ec9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d7ee65-e32c-42a3-86e2-2858752a8fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3e4519c2474a89b7738b3e2395c506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3065c891-498a-41ef-85d9-6d811a745922,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:42:42Z,use_quota=True,user_id='d8d987665db4416ba2f1f5951283f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9113bfe-65c5-4a2a-9bd9-2ecea6a5a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9113bfe-65c5-4a2a-9bd9-2ecea6a5a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8ce78-b419-4918-9492-a92f3f096c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8ce78-b419-4918-9492-a92f3f096c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4d7ee65-e32c-42a3-86e2-2858752a8fd6', 'volume_name': 'volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6', 'volume_size': 1, 'snapshot_id': '3065c891-498a-41ef-85d9-6d811a745922'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8094b05-b8c2-4230-826c-f08ccdbc8bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8094b05-b8c2-4230-826c-f08ccdbc8bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b827b7e-3ae4-485d-a0cd-d505b0ddd902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Volume c4d7ee65-e32c-42a3-86e2-2858752a8fd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6', 'volume_size': 1, 'snapshot_id': '3065c891-498a-41ef-85d9-6d811a745922'} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" by "_create_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Creating volume c4d7ee65-e32c-42a3-86e2-2858752a8fd6 from snapshot 3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" by "_copy_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] snapshot: 3065c891-498a-41ef-85d9-6d811a745922, volume: c4d7ee65-e32c-42a3-86e2-2858752a8fd6, {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[11493eb1-c004-48a4-bdec-5af69bb690be]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:42 devstack quobyte-client[84349]: System call of process 100298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:42 devstack quobyte-client[84349]: System call of process 100298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:42 devstack quobyte-client[84349]: System call of process 100298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.381s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a6b55c-3102-404d-b348-f9d43b31e9e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Creating direct copy from snapshot {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9f505-3c47-4eb2-b9c5-d958dc578629]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.593s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:43 devstack cinder-volume[84334]: DEBUG cinder.utils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 not found in is_blk_device check {{(pid=84334) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 25 21:42:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:43 devstack quobyte-client[84349]: System call of process 100304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:43 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:43 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=126, name=volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" returned: 0 in 4.352s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:47 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[219efb53-1c94-4f48-850b-7fac008721de]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.543s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:47 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:42:47 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Converted 1024.00 MB image at 235.06 MB/s Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" returned: 0 in 0.080s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" released by "_copy_volume_from_snapshot" :: held 6.290s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" released by "_create_volume_from_snapshot" :: held 6.327s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.344s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.098s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Creating offline snapshot 115b655d-7b63-4933-b26c-af6bfec0cf78 of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc5d434-19c5-46e6-9268-10077f690509]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b827b7e-3ae4-485d-a0cd-d505b0ddd902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6', 'volume_size': 1, 'snapshot_id': '3065c891-498a-41ef-85d9-6d811a745922'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13386bf7-2c9e-49f2-b0bd-e2dfbad9db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:42:48 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Volume volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 (c4d7ee65-e32c-42a3-86e2-2858752a8fd6): created successfully Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13386bf7-2c9e-49f2-b0bd-e2dfbad9db2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Flow 'volume_create_manager' (fa23b624-379a-4a2e-a8b0-55fc5db52993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:42:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b0153ef2-1020-4eba-82bb-5936ae47513a tempest-SnapshotDependencyTests-1311580292 None] Created volume successfully. Sep 25 21:42:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862" returned: 0 in 0.530s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:49 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=127, name=volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 1G" returned: 0 in 0.229s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.135s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.094s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.097s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.info" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-3065c891-498a-41ef-85d9-6d811a745922-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.info" returned: 0 in 0.267s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-3065c891-498a-41ef-85d9-6d811a745922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.202s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:50 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=55,cinder:UPDATE=65,cinder:INSERT=22,cinder:DELETE=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=41,cinder:UPDATE=53,cinder:DELETE=6,cinder:INSERT=11 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" acquired by "delete_snapshot" :: waited 0.104s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Deleting offline snapshot 3065c891-498a-41ef-85d9-6d811a745922 of volume 68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] snapshot_file for this snap is: volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:42:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0055ae2f-8537-48a1-9ba9-a4e681e82577 tempest-VolumesSnapshotListTestJSON-1615347806 None] Create snapshot completed successfully Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2235d65-54f9-40eb-b2e8-715f3e499141]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a6b55c-3102-404d-b348-f9d43b31e9e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb155e0-f999-489b-8078-adb11f4a8b67]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.480s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:52 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Creating offline snapshot bad314c7-90f8-4e2f-9743-98cfcccfeb0a of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0.3065c891-498a-41ef-85d9-6d811a745922" returned: 0 in 0.385s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35da1ce-5f75-4f80-b958-a05a508d4b16]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-3065c891-498a-41ef-85d9-6d811a745922" released by "_delete_snapshot" :: held 2.051s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" released by "delete_snapshot" :: held 2.151s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.527s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:42:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:52 devstack quobyte-client[84349]: System call of process 100346 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:52 devstack quobyte-client[84349]: System call of process 100346 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:53 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=129, name=volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Created reservations ['4efed4bf-fb6f-4acb-bb6f-72d92a6eb746', '8e7b2705-9d01-43df-83c1-80000c3f26ef', '44677037-58d1-41ad-8d14-d4ec466ad08d', '504a58c5-ce0e-4e98-ac40-7b5368b1e6d9'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a 1G" returned: 0 in 0.367s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.269s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.286s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:42:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.168s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Delete snapshot completed successfully. Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-68a6b55c-3102-404d-b348-f9d43b31e9e0-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d9c3097-0461-43f1-96bc-ce8798ca4293 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-3065c891-498a-41ef-85d9-6d811a745922-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:54 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fb3cba66-2cb6-4e53-bf69-fa27c610cee2 tempest-VolumesSnapshotListTestJSON-1615347806 None] Create snapshot completed successfully Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-68a6b55c-3102-404d-b348-f9d43b31e9e0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" acquired by "delete_volume" :: waited 0.010s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afdc656-ef90-44d6-9ca8-64f26500ce49]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:54 devstack quobyte-client[84349]: System call of process 100355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.419s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68a6b55c-3102-404d-b348-f9d43b31e9e0" returned: 0 in 0.339s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-68a6b55c-3102-404d-b348-f9d43b31e9e0" released by "delete_volume" :: held 0.974s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Creating offline snapshot 21d92562-bf1a-4d3b-9a51-1a6962b6e6dc of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6fa37-7c0e-4f99-8448-a3473e2e52e2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:55 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Created reservations ['f2224819-cd0d-438b-a20a-b2dbd1a5639c', '9699df80-b78b-4be6-91d9-e9c6229633f5', '0c396009-82d7-4044-a30a-74174e961ee8', '148cdacc-1288-420f-9f32-b74a72830ff5'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.553s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:56 devstack quobyte-client[84349]: System call of process 100362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:56 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=130, name=volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.122s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:42:56 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Deleted volume successfully. Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc 1G" returned: 0 in 0.604s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-c4d7ee65-e32c-42a3-86e2-2858752a8fd6-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:56 devstack quobyte-client[84349]: System call of process 100366 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img rebase -u -b volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.221s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c6ae22c9-4929-43a4-b6c3-bb97eb2e3404 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-68a6b55c-3102-404d-b348-f9d43b31e9e0-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:42:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-c4d7ee65-e32c-42a3-86e2-2858752a8fd6-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.313s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.337s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:57 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:57 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-54e5e0c7-90b2-4c20-8a4a-be53c0ae1b2f tempest-VolumesSnapshotListTestJSON-1615347806 None] Create snapshot completed successfully Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" acquired by "delete_volume" :: waited 0.109s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7301c7-3bf4-49e8-bb45-0330ec8a2eb2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:42:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:58 devstack quobyte-client[84349]: System call of process 100371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:42:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" returned: 0 in 0.431s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" returned: 0 in 0.247s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-quobyte-c4d7ee65-e32c-42a3-86e2-2858752a8fd6" released by "delete_volume" :: held 0.909s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Created reservations ['6b3ed9dd-aed8-4b9d-9149-cbeb64d3de21', '4d49f9f9-ea43-42dd-9294-7e8ee1210462', 'a132739b-5b6d-4376-b8e9-ceecb6a3f2ce', '055a2c0f-48ef-4e71-b68c-36ec77295648'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.322s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:59 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:59 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Deleted volume successfully. Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" acquired by "delete_snapshot" :: waited 0.117s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-39bf2cad-cb4f-48cc-a21b-6fcbfd1e4e86 tempest-SnapshotDependencyTests-1311580292 None] Lock "cinder-c4d7ee65-e32c-42a3-86e2-2858752a8fd6-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:42:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Deleting offline snapshot 21d92562-bf1a-4d3b-9a51-1a6962b6e6dc of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] snapshot_file for this snap is: volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[094eebf7-b82e-4796-b96b-9bf6cc2b5048]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.520s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c69e26-1dc9-42a6-8e39-fe6910d57b25]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:01 devstack quobyte-client[84349]: System call of process 100379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:01 devstack quobyte-client[84349]: System call of process 100379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.482s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:01 devstack quobyte-client[84349]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.320s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" returned: 0 in 0.115s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc" released by "_delete_snapshot" :: held 1.788s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" released by "delete_snapshot" :: held 1.833s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Created reservations ['fdaf853e-a08b-47f0-a2e8-a1219a743668', 'aebc6a7d-69bd-412a-8151-502fcad5108f', 'e343aa2c-07af-45cf-977e-2fb477163f75', 'd12e5292-a428-4fa9-9389-6c986fa2a8c9'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Delete snapshot completed successfully. Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-b4a356e7-bb3d-4052-b951-1a178b893794 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-21d92562-bf1a-4d3b-9a51-1a6962b6e6dc-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-bad314c7-90f8-4e2f-9743-98cfcccfeb0a-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-bad314c7-90f8-4e2f-9743-98cfcccfeb0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-bad314c7-90f8-4e2f-9743-98cfcccfeb0a" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-bad314c7-90f8-4e2f-9743-98cfcccfeb0a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Deleting offline snapshot bad314c7-90f8-4e2f-9743-98cfcccfeb0a of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] snapshot_file for this snap is: volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c3622d-49be-4cd1-942b-e4825923d49d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:03 devstack quobyte-client[84349]: System call of process 100388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.441s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:03 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e912f46-6785-45b9-96a3-489161f6a3d9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:03 devstack quobyte-client[84349]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:03 devstack quobyte-client[84349]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:03 devstack quobyte-client[84349]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.482s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:04 devstack quobyte-client[84349]: System call of process 100394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.250s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.bad314c7-90f8-4e2f-9743-98cfcccfeb0a" returned: 0 in 0.155s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-bad314c7-90f8-4e2f-9743-98cfcccfeb0a" released by "_delete_snapshot" :: held 1.823s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" released by "delete_snapshot" :: held 1.878s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:05 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Created reservations ['002e8467-d98e-4e62-b63e-1837afa5f6b9', '1aa2d8b4-471b-476f-bed1-c514138240b5', '91497cea-924c-4140-b039-ea0a53bb3bb9', '5a39bf4f-94ac-4f6f-9106-6438fd3aa324'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Delete snapshot completed successfully. Sep 25 21:43:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-c9807adf-804c-4a89-b24a-a2928266286b tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-bad314c7-90f8-4e2f-9743-98cfcccfeb0a-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-115b655d-7b63-4933-b26c-af6bfec0cf78-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-115b655d-7b63-4933-b26c-af6bfec0cf78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:06 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-115b655d-7b63-4933-b26c-af6bfec0cf78" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-115b655d-7b63-4933-b26c-af6bfec0cf78" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Deleting offline snapshot 115b655d-7b63-4933-b26c-af6bfec0cf78 of volume 98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] snapshot_file for this snap is: volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[613fe432-53a9-4ff0-8fa3-2d35c288be1c]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.501s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e46269-1c05-465c-8f22-acd86520d862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe04e6e1-172f-446a-9a30-647c4f017d7a]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862" returned: 0 in 0.503s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.241s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862.115b655d-7b63-4933-b26c-af6bfec0cf78" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-115b655d-7b63-4933-b26c-af6bfec0cf78" released by "_delete_snapshot" :: held 1.747s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" released by "delete_snapshot" :: held 1.772s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:08 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Created reservations ['3eca7b39-f75d-4e76-be53-691f3e861154', 'e70d9a6c-3618-4c86-aa88-b9ece0de2aa7', 'd99a3d37-2577-4f22-be42-fea9f4a7d790', '7b1ec920-94b7-4de6-bfd4-077b6aea9fc5'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Delete snapshot completed successfully. Sep 25 21:43:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac4af543-4213-4bff-9ff4-1557dbc479d6 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-115b655d-7b63-4933-b26c-af6bfec0cf78-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-98e46269-1c05-465c-8f22-acd86520d862-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-98e46269-1c05-465c-8f22-acd86520d862-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d9208-1c23-4b59-975f-d0d06aa8d528]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862" returned: 0 in 0.517s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-98e46269-1c05-465c-8f22-acd86520d862" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-quobyte-98e46269-1c05-465c-8f22-acd86520d862" released by "delete_volume" :: held 0.827s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:10 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Created reservations ['ef6ef39b-ae6a-470a-ad55-1f22308d2e04', '51dc2951-62dc-4742-b32f-cb328a5926f4', 'f4422f82-b2b2-448d-aee7-5f96e9c4b82f', '341c7b5a-e5e0-4540-b24a-d3a28ef1cf66'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.141s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:43:11 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Deleted volume successfully. Sep 25 21:43:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24c5625f-d706-4a22-bb7d-936b284b3556 tempest-VolumesSnapshotListTestJSON-1615347806 None] Lock "cinder-98e46269-1c05-465c-8f22-acd86520d862-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:15 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Flow 'volume_create_manager' (9498b383-4de1-45cc-8ced-522650b4ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629b7135-56e6-49ef-9482-3ff84d5713c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629b7135-56e6-49ef-9482-3ff84d5713c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1169440246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951e4e8a-5f06-4fb1-a554-4780938d6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4cafc16eeb4409aed9432e8336ad32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:16Z,use_quota=True,user_id='4dd9dedc35de46a7b3d9e3499acfaa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b26fd63-5bbb-4db1-bc1e-da8fa6f6f683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b26fd63-5bbb-4db1-bc1e-da8fa6f6f683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38eb7b5b-e5c6-4737-9b0d-306ed5a157f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38eb7b5b-e5c6-4737-9b0d-306ed5a157f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951e4e8a-5f06-4fb1-a554-4780938d6542', 'volume_name': 'volume-951e4e8a-5f06-4fb1-a554-4780938d6542', 'volume_size': 2}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9813837b-f136-4ba2-bef9-45bfc164b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9813837b-f136-4ba2-bef9-45bfc164b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693566e3-b7a2-4ae3-9a2e-e2244a0d40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:15 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume 951e4e8a-5f06-4fb1-a554-4780938d6542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951e4e8a-5f06-4fb1-a554-4780938d6542', 'volume_size': 2} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1169440246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951e4e8a-5f06-4fb1-a554-4780938d6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4cafc16eeb4409aed9432e8336ad32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:16Z,use_quota=True,user_id='4dd9dedc35de46a7b3d9e3499acfaa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Creating volume 951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:43:15 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:43:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 2147483648 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:16 devstack quobyte-client[84349]: System call of process 100419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:16 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=131, name=volume-951e4e8a-5f06-4fb1-a554-4780938d6542, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 2147483648" returned: 0 in 0.424s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542" returned: 0 in 0.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693566e3-b7a2-4ae3-9a2e-e2244a0d40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951e4e8a-5f06-4fb1-a554-4780938d6542', 'volume_size': 2}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e18697-8f53-45f9-b22b-1679fd2f7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:16 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume volume-951e4e8a-5f06-4fb1-a554-4780938d6542 (951e4e8a-5f06-4fb1-a554-4780938d6542): created successfully Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e18697-8f53-45f9-b22b-1679fd2f7d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Flow 'volume_create_manager' (9498b383-4de1-45cc-8ced-522650b4ed47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:16 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cc7aacc3-9e5b-4f80-b3ac-5050397cf24e tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Created volume successfully. Sep 25 21:43:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Creating offline snapshot 20f8064c-c123-4af9-bfcf-54601eee0958 of volume 951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[58775736-9448-46ca-9ead-6c5b00b0bf26]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542" returned: 0 in 0.402s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 2G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:18 devstack quobyte-client[84349]: System call of process 100426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:18 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=132, name=volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 2G" returned: 0 in 0.234s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): qemu-img rebase -u -b volume-951e4e8a-5f06-4fb1-a554-4780938d6542 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "qemu-img rebase -u -b volume-951e4e8a-5f06-4fb1-a554-4780938d6542 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.125s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.info" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.info" returned: 0 in 0.086s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.441s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8d0a6aba-ec1d-4c62-8ea9-864523e25be5 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Create snapshot completed successfully Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "cinder-20f8064c-c123-4af9-bfcf-54601eee0958-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-20f8064c-c123-4af9-bfcf-54601eee0958-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "cinder-quobyte-20f8064c-c123-4af9-bfcf-54601eee0958" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-20f8064c-c123-4af9-bfcf-54601eee0958" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Deleting offline snapshot 20f8064c-c123-4af9-bfcf-54601eee0958 of volume 951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] snapshot_file for this snap is: volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2e3f3-e2e9-48b9-b6bf-104f7089e127]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.380s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-951e4e8a-5f06-4fb1-a554-4780938d6542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5492a813-04e0-442e-adb6-d0c88eb13090]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:21 devstack quobyte-client[84349]: System call of process 100439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542" returned: 0 in 0.397s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.230s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542.20f8064c-c123-4af9-bfcf-54601eee0958" returned: 0 in 0.087s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-20f8064c-c123-4af9-bfcf-54601eee0958" released by "_delete_snapshot" :: held 1.402s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" released by "delete_snapshot" :: held 1.430s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Created reservations ['963e9bc4-a596-4071-8990-e15d2502aaf7', '420c0b1c-b92f-4aa2-b2c4-aec479d1834f', '17c1b16c-f515-422b-8584-d4fd4dc24ca0', 'c95e57e0-60d8-452c-a79f-31e0acf50d8f'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Delete snapshot completed successfully. Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-572360ab-3c17-45f5-acb9-88e7b6362ebb tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-20f8064c-c123-4af9-bfcf-54601eee0958-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "cinder-951e4e8a-5f06-4fb1-a554-4780938d6542-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-951e4e8a-5f06-4fb1-a554-4780938d6542-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ac52e-c353-4903-8631-82521b74ea16]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:43:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542" returned: 0 in 0.377s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-951e4e8a-5f06-4fb1-a554-4780938d6542" returned: 0 in 0.115s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-quobyte-951e4e8a-5f06-4fb1-a554-4780938d6542" released by "delete_volume" :: held 0.658s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Created reservations ['8293bedf-5292-45f4-8f99-26255ac72c69', '500977c1-6103-4bfd-924c-d2685aeebb99', '40f4d58f-5881-46e7-864c-324235facb7d', 'a8bf8ec8-e398-47ad-8f20-062e6409ef04'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:23 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:43:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Deleted volume successfully. Sep 25 21:43:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-d885c727-e9ed-43ff-bb10-42e4135c0bd2 tempest-VolumesSnapshotNegativeTestJSON-1658607403 None] Lock "cinder-951e4e8a-5f06-4fb1-a554-4780938d6542-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:43:33 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=53,cinder:INSERT=19,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:43:34 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:DELETE=5,cinder:SELECT=43,cinder:UPDATE=59,cinder:INSERT=17 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:43:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Flow 'volume_create_manager' (5637fbf8-41cd-4746-a850-c2cefa57f278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd472d4-efb3-4c22-8793-de72a98abf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd472d4-efb3-4c22-8793-de72a98abf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871149347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c84663-4ff0-4572-8194-b9af4a658ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51917381a3b4c5cb4fa0d8493e78146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:48Z,use_quota=True,user_id='a492ee55405d476a9697eee27e0b1f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b927475-f6d6-481d-b3d8-1a8b73a29999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b927475-f6d6-481d-b3d8-1a8b73a29999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848b66eb-3902-41fe-a171-1b9f478c01b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848b66eb-3902-41fe-a171-1b9f478c01b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c84663-4ff0-4572-8194-b9af4a658ecc', 'volume_name': 'volume-17c84663-4ff0-4572-8194-b9af4a658ecc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a9b24c-2a4d-447f-8d8d-f81a53669002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a9b24c-2a4d-447f-8d8d-f81a53669002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ff891-0d5b-4840-acd7-9139a3d542c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:48 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume 17c84663-4ff0-4572-8194-b9af4a658ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c84663-4ff0-4572-8194-b9af4a658ecc', 'volume_size': 1} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871149347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c84663-4ff0-4572-8194-b9af4a658ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51917381a3b4c5cb4fa0d8493e78146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:48Z,use_quota=True,user_id='a492ee55405d476a9697eee27e0b1f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Creating volume 17c84663-4ff0-4572-8194-b9af4a658ecc {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:43:48 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:48 devstack quobyte-client[84349]: System call of process 100496 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:48 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=134, name=volume-17c84663-4ff0-4572-8194-b9af4a658ecc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:43:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Flow 'volume_create_manager' (d1138033-e91e-4486-adb7-d0c431512a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:48 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64790b3-f124-4b99-b426-ebe57906932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64790b3-f124-4b99-b426-ebe57906932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1374690403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3848fbf-ee51-4f24-a081-8a3d8ab81ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51917381a3b4c5cb4fa0d8493e78146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:48Z,use_quota=True,user_id='a492ee55405d476a9697eee27e0b1f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08327ea-e6dc-49d8-9684-4e7478fa4636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08327ea-e6dc-49d8-9684-4e7478fa4636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f29fb7-7517-4bee-a041-a10eb75462c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f29fb7-7517-4bee-a041-a10eb75462c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3848fbf-ee51-4f24-a081-8a3d8ab81ca2', 'volume_name': 'volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df42fe90-234f-4c99-beed-19ca9f7f55b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df42fe90-234f-4c99-beed-19ca9f7f55b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eedbb2-9c9a-444c-a5c4-7656faa82aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume f3848fbf-ee51-4f24-a081-8a3d8ab81ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2', 'volume_size': 1} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc 1073741824" returned: 0 in 0.689s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] <== create_volume: return (854ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1374690403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3848fbf-ee51-4f24-a081-8a3d8ab81ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51917381a3b4c5cb4fa0d8493e78146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:43:48Z,use_quota=True,user_id='a492ee55405d476a9697eee27e0b1f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Creating volume f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:43:49 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:49 devstack quobyte-client[84349]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:49 devstack quobyte-client[84349]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:49 devstack quobyte-client[84349]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:49 devstack quobyte-client[84349]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:49 devstack quobyte-client[84349]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:43:49 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=135, name=volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ff891-0d5b-4840-acd7-9139a3d542c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c84663-4ff0-4572-8194-b9af4a658ecc', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621515c8-31d4-40ea-903f-3a977d1c14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:49 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume volume-17c84663-4ff0-4572-8194-b9af4a658ecc (17c84663-4ff0-4572-8194-b9af4a658ecc): created successfully Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621515c8-31d4-40ea-903f-3a977d1c14d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Flow 'volume_create_manager' (5637fbf8-41cd-4746-a850-c2cefa57f278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:49 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-156db1f0-8710-440d-b4c3-1e3888afdd2c tempest-TestServerVolumeAttachmentScenario-1108199959 None] Created volume successfully. Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 1073741824" returned: 0 in 0.456s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" returned: 0 in 0.137s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eedbb2-9c9a-444c-a5c4-7656faa82aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27779a3-39e1-455e-a8cd-e71144e3a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:43:50 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 (f3848fbf-ee51-4f24-a081-8a3d8ab81ca2): created successfully Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27779a3-39e1-455e-a8cd-e71144e3a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:43:50 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Flow 'volume_create_manager' (d1138033-e91e-4486-adb7-d0c431512a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:43:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0ac19b59-3b29-4eb9-8154-f4959960356d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Created volume successfully. Sep 25 21:44:00 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:44:00 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.095s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:44:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6503b925-4992-423a-a842-797dd8340130]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:45:21 devstack quobyte-client[84349]: System call of process 100724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc" returned: 0 in 0.410s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:45:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-17c84663-4ff0-4572-8194-b9af4a658ecc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '199677c0-7cfd-4cb2-9805-222990e5d32b', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:45:21 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:45:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-bc92230f-adf7-48ed-ad39-ae0a79c2abd0 req-8b0767f6-5c05-4f31-abe7-34bc93856e3d tempest-TestServerVolumeAttachmentScenario-1108199959 None] attachment_update completed successfully. Sep 25 21:45:32 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:45:32 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[95742821-9f41-416c-a6ad-1b90b9e960c5]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" returned: 0 in 0.404s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.457s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:45:34 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002', 'name': 'volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e641d6d-7faf-460c-8929-d4f66b98e421', 'enforce_multipath': True} {{(pid=84334) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 25 21:45:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:45:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-77cd1e52-7b7c-4a04-ba63-a22aca8e3f9d req-cd2b631b-8404-4877-9cd1-43f17103d841 tempest-TestServerVolumeAttachmentScenario-1108199959 None] attachment_update completed successfully. Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.111s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:45:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:45:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:45:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-07b79968-ef8b-466d-b4dc-e2785cf7a6e2 req-3809f35e-fe87-4caf-980c-52ae1f77d7df tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:03 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-07b79968-ef8b-466d-b4dc-e2785cf7a6e2 req-3809f35e-fe87-4caf-980c-52ae1f77d7df tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-07b79968-ef8b-466d-b4dc-e2785cf7a6e2 req-3809f35e-fe87-4caf-980c-52ae1f77d7df tempest-TestServerVolumeAttachmentScenario-1108199959 None] Terminate volume connection completed successfully. Sep 25 21:46:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-07b79968-ef8b-466d-b4dc-e2785cf7a6e2 req-3809f35e-fe87-4caf-980c-52ae1f77d7df tempest-TestServerVolumeAttachmentScenario-1108199959 None] Deleting attachment 4e641d6d-7faf-460c-8929-d4f66b98e421. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:46:12 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:13 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ce45cb7c-6b0c-428a-86f3-f480ebd43607 req-08da942b-72ba-4662-a9ad-e07e0aa9df14 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:27 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [req-ce45cb7c-6b0c-428a-86f3-f480ebd43607 req-08da942b-72ba-4662-a9ad-e07e0aa9df14 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:27 devstack cinder-volume[84334]: INFO cinder.volume.manager [req-ce45cb7c-6b0c-428a-86f3-f480ebd43607 req-08da942b-72ba-4662-a9ad-e07e0aa9df14 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Terminate volume connection completed successfully. Sep 25 21:46:27 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [req-ce45cb7c-6b0c-428a-86f3-f480ebd43607 req-08da942b-72ba-4662-a9ad-e07e0aa9df14 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Deleting attachment 199677c0-7cfd-4cb2-9805-222990e5d32b. {{(pid=84334) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 25 21:46:37 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:37 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "cinder-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:46:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "cinder-quobyte-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-quobyte-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" acquired by "delete_volume" :: waited 0.197s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.222s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9a8a61-6f5a-48c6-a6e5-0e1e8a6f251f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:46:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" returned: 0 in 0.422s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" returned: 0 in 0.083s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-quobyte-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2" released by "delete_volume" :: held 0.722s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Created reservations ['7a19af07-c1b7-488b-80e3-b8397fdb6468', '1173e636-b0d9-4e7a-823c-26a36c1b6a33', 'bd1e479b-9df8-4c30-a2a6-8715ba34ddee', '93c718e6-edee-4a1e-a429-6b464d05c76a'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:46:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.084s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:46:42 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Deleted volume successfully. Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-20a7d9eb-90cb-4c4b-8692-0126ae1c9808 tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-f3848fbf-ee51-4f24-a081-8a3d8ab81ca2-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "cinder-17c84663-4ff0-4572-8194-b9af4a658ecc-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-17c84663-4ff0-4572-8194-b9af4a658ecc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:46:42 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "cinder-quobyte-17c84663-4ff0-4572-8194-b9af4a658ecc" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-quobyte-17c84663-4ff0-4572-8194-b9af4a658ecc" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[60204a24-d5d8-4744-a244-a3669e52a6ba]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:46:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc" returned: 0 in 0.394s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17c84663-4ff0-4572-8194-b9af4a658ecc" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-quobyte-17c84663-4ff0-4572-8194-b9af4a658ecc" released by "delete_volume" :: held 0.640s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Created reservations ['b132180b-ba4d-4dd9-b3ea-703fbaf8ceb6', '3483a94c-4f66-4b5e-8936-51b6d72b034a', '35794fe7-e38a-4417-aa14-29807ef668d3', 'c5ea69ae-e3b4-4a4b-87b4-89c4ebd4590e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:46:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.103s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:44 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:46:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Deleted volume successfully. Sep 25 21:46:44 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-ac56205d-a9a3-4826-8061-0be6178366dd tempest-TestServerVolumeAttachmentScenario-1108199959 None] Lock "cinder-17c84663-4ff0-4572-8194-b9af4a658ecc-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:46:53 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=8,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:54 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:46:57 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:46:57 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (5dabfac6-4505-4cc8-98b3-40008834e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dc2142-d4d4-471d-b5da-fef0ee049416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dc2142-d4d4-471d-b5da-fef0ee049416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637869032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb08b151-6867-4697-b700-39a04eac4a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:46:58Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4ea18-5d49-4e8a-9c90-74090252d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4ea18-5d49-4e8a-9c90-74090252d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f929988-0764-4362-8ba4-b3b268a8d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f929988-0764-4362-8ba4-b3b268a8d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb08b151-6867-4697-b700-39a04eac4a37', 'volume_name': 'volume-fb08b151-6867-4697-b700-39a04eac4a37', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa17e0f-29cc-423e-8b99-f296959834d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa17e0f-29cc-423e-8b99-f296959834d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0dc13c5-5dc5-443c-b588-c9b79383d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume fb08b151-6867-4697-b700-39a04eac4a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb08b151-6867-4697-b700-39a04eac4a37', 'volume_size': 1} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637869032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb08b151-6867-4697-b700-39a04eac4a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:46:58Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume fb08b151-6867-4697-b700-39a04eac4a37 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:46:58 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:58 devstack quobyte-client[84349]: System call of process 101394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:46:58 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=136, name=volume-fb08b151-6867-4697-b700-39a04eac4a37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37 1073741824" returned: 0 in 0.309s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37" returned: 0 in 0.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (458ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.469s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0dc13c5-5dc5-443c-b588-c9b79383d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb08b151-6867-4697-b700-39a04eac4a37', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4493d0-6672-42dc-b7a2-6ec72ec77c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:46:58 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-fb08b151-6867-4697-b700-39a04eac4a37 (fb08b151-6867-4697-b700-39a04eac4a37): created successfully Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4493d0-6672-42dc-b7a2-6ec72ec77c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:46:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (5dabfac6-4505-4cc8-98b3-40008834e893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:46:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-39712e83-14d2-4d1d-afad-8f871519b9ef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (5b705ad1-16ec-41d4-8359-6644c15a4593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e325ab-9453-4021-9d99-6708a29c1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e325ab-9453-4021-9d99-6708a29c1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918310293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6253cca-4876-4ca6-9d91-d86c0a670467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:00Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f449666-0c81-413b-b16f-ff89b2db85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f449666-0c81-413b-b16f-ff89b2db85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd481f9c-536d-4e4e-93be-255c47e0c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd481f9c-536d-4e4e-93be-255c47e0c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6253cca-4876-4ca6-9d91-d86c0a670467', 'volume_name': 'volume-f6253cca-4876-4ca6-9d91-d86c0a670467', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ca2cf-11f7-4a1c-b270-00e4a37990da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ca2cf-11f7-4a1c-b270-00e4a37990da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b27dfb-e4fd-499e-97e2-17da503f2d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume f6253cca-4876-4ca6-9d91-d86c0a670467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6253cca-4876-4ca6-9d91-d86c0a670467', 'volume_size': 1} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918310293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6253cca-4876-4ca6-9d91-d86c0a670467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:00Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume f6253cca-4876-4ca6-9d91-d86c0a670467 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:00 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:00 devstack quobyte-client[84349]: System call of process 101398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:00 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=137, name=volume-f6253cca-4876-4ca6-9d91-d86c0a670467, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467 1073741824" returned: 0 in 0.499s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (93c46b08-d9df-4ed0-9f65-14c49e55b1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62949a95-f94a-49e8-bd4f-19075b9e7d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467" returned: 0 in 0.563s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (1136ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62949a95-f94a-49e8-bd4f-19075b9e7d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526363490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b66f0b-5c29-4670-8fbf-e27c455e2d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:01Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180879eb-687a-46b1-ad1b-0a9400df420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180879eb-687a-46b1-ad1b-0a9400df420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c05e17-1594-41f0-986f-c3e763f80381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c05e17-1594-41f0-986f-c3e763f80381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b66f0b-5c29-4670-8fbf-e27c455e2d93', 'volume_name': 'volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c936e71-538a-45c7-8a0b-a59a6455367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c936e71-538a-45c7-8a0b-a59a6455367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acef470-28c4-4241-9f02-8a2b4cf271da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume a7b66f0b-5c29-4670-8fbf-e27c455e2d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93', 'volume_size': 1} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526363490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b66f0b-5c29-4670-8fbf-e27c455e2d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:01Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume a7b66f0b-5c29-4670-8fbf-e27c455e2d93 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:01 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:01 devstack quobyte-client[84349]: System call of process 101402 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:01 devstack quobyte-client[84349]: System call of process 101402 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:01 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=138, name=volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (eeb29215-f5f5-4acf-9bbd-3d492f232877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d517d7-70cb-4edb-a874-14d176584712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b27dfb-e4fd-499e-97e2-17da503f2d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6253cca-4876-4ca6-9d91-d86c0a670467', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efa30fc-034f-4d43-95cf-452f8f6e5dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (c96d59c2-2901-4ab4-932c-8d7fe2f58120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffae7e34-208d-43a3-aada-f929edce4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 1073741824" returned: 0 in 0.727s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (de2f6bcc-7226-4a16-9d8b-9c63e5537f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d70e6d-0a72-4af1-9bea-2fbc235f7557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d517d7-70cb-4edb-a874-14d176584712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610732068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb903cdc-fd18-404b-aa36-3d7b49044963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:02Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad1774c-d278-49bf-8761-8339df3030db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad1774c-d278-49bf-8761-8339df3030db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f8b9b-1173-4935-8bf1-f5c9070b3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f8b9b-1173-4935-8bf1-f5c9070b3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb903cdc-fd18-404b-aa36-3d7b49044963', 'volume_name': 'volume-bb903cdc-fd18-404b-aa36-3d7b49044963', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800083ad-aec7-4758-866b-b52a42157fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800083ad-aec7-4758-866b-b52a42157fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef94a596-a2d0-499a-9018-9789b6ee2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume bb903cdc-fd18-404b-aa36-3d7b49044963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb903cdc-fd18-404b-aa36-3d7b49044963', 'volume_size': 1} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d70e6d-0a72-4af1-9bea-2fbc235f7557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292030454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749610f1-b346-474f-8f70-675e0ec9d303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:02Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4efdcfd-2558-4dc3-8e15-737f0f0ddd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4efdcfd-2558-4dc3-8e15-737f0f0ddd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07593f27-76d4-4b0b-90d7-9521047e0959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07593f27-76d4-4b0b-90d7-9521047e0959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749610f1-b346-474f-8f70-675e0ec9d303', 'volume_name': 'volume-749610f1-b346-474f-8f70-675e0ec9d303', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25247e19-b3ba-452a-ac37-1e60a97d505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25247e19-b3ba-452a-ac37-1e60a97d505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df1c717-2bf2-4fdc-8650-6826cc6cf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume 749610f1-b346-474f-8f70-675e0ec9d303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749610f1-b346-474f-8f70-675e0ec9d303', 'volume_size': 1} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-f6253cca-4876-4ca6-9d91-d86c0a670467 (f6253cca-4876-4ca6-9d91-d86c0a670467): created successfully Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efa30fc-034f-4d43-95cf-452f8f6e5dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (5b705ad1-16ec-41d4-8359-6644c15a4593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffae7e34-208d-43a3-aada-f929edce4f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218539445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f36d6a6-9265-4ab5-a2bd-4d0574e43132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:01Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ae6a-fe03-41cc-9879-fb3833bd3e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ae6a-fe03-41cc-9879-fb3833bd3e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd6d7ef-7620-4039-9d4a-7b7f74d608f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd6d7ef-7620-4039-9d4a-7b7f74d608f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f36d6a6-9265-4ab5-a2bd-4d0574e43132', 'volume_name': 'volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ddc90-d100-4c12-8cbf-d060407d9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ddc90-d100-4c12-8cbf-d060407d9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6105a0a7-a207-4086-8e54-ea5634932fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume 4f36d6a6-9265-4ab5-a2bd-4d0574e43132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132', 'volume_size': 1} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" returned: 0 in 0.599s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (1351ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610732068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb903cdc-fd18-404b-aa36-3d7b49044963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:02Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume bb903cdc-fd18-404b-aa36-3d7b49044963 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f55f96a7-e5b1-4f85-aefe-d9c5eb7266af tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:03 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=139, name=volume-bb903cdc-fd18-404b-aa36-3d7b49044963, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acef470-28c4-4241-9f02-8a2b4cf271da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21ead21-fe7d-4cbe-a5b0-e84a5ef49d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 (a7b66f0b-5c29-4670-8fbf-e27c455e2d93): created successfully Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21ead21-fe7d-4cbe-a5b0-e84a5ef49d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (93c46b08-d9df-4ed0-9f65-14c49e55b1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963 1073741824" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fa165d23-4b82-425d-b57b-ca7595493c69 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963" returned: 0 in 0.218s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (677ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292030454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749610f1-b346-474f-8f70-675e0ec9d303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:02Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume 749610f1-b346-474f-8f70-675e0ec9d303 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:03 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:03 devstack quobyte-client[84349]: System call of process 101410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:03 devstack quobyte-client[84349]: System call of process 101410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:04 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=140, name=volume-749610f1-b346-474f-8f70-675e0ec9d303, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef94a596-a2d0-499a-9018-9789b6ee2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb903cdc-fd18-404b-aa36-3d7b49044963', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ae7a2c-7edf-4b2a-9255-fcf2d58fd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:04 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-bb903cdc-fd18-404b-aa36-3d7b49044963 (bb903cdc-fd18-404b-aa36-3d7b49044963): created successfully Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ae7a2c-7edf-4b2a-9255-fcf2d58fd020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (eeb29215-f5f5-4acf-9bbd-3d492f232877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303 1073741824" returned: 0 in 0.420s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2a0926bb-a7a9-40d8-9fad-0c96289c90d4 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303" returned: 0 in 0.251s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (701ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218539445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f36d6a6-9265-4ab5-a2bd-4d0574e43132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8b1bfb8a934f55897612bbe518869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:01Z,use_quota=True,user_id='34fd8e4a5b3f485ca255f9c384caff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Creating volume 4f36d6a6-9265-4ab5-a2bd-4d0574e43132 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:04 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:04 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=141, name=volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df1c717-2bf2-4fdc-8650-6826cc6cf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749610f1-b346-474f-8f70-675e0ec9d303', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9457b949-594b-4737-86af-4592faed9328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:04 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-749610f1-b346-474f-8f70-675e0ec9d303 (749610f1-b346-474f-8f70-675e0ec9d303): created successfully Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9457b949-594b-4737-86af-4592faed9328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:04 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (de2f6bcc-7226-4a16-9d8b-9c63e5537f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 1073741824" returned: 0 in 0.419s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-32fbedff-5c94-4f9b-b928-3f52de36f643 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6105a0a7-a207-4086-8e54-ea5634932fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b4716e-24d6-4470-bf7f-e3024cf3854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:05 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 (4f36d6a6-9265-4ab5-a2bd-4d0574e43132): created successfully Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b4716e-24d6-4470-bf7f-e3024cf3854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:05 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Flow 'volume_create_manager' (c96d59c2-2901-4ab4-932c-8d7fe2f58120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:05 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-2b1b3390-f2ee-4706-92a2-c7e218093921 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created volume successfully. Sep 25 21:47:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-749610f1-b346-474f-8f70-675e0ec9d303-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:06 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-749610f1-b346-474f-8f70-675e0ec9d303-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-749610f1-b346-474f-8f70-675e0ec9d303" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-749610f1-b346-474f-8f70-675e0ec9d303" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[44848210-29f1-49ef-b96f-6b1fb54da402]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303" returned: 0 in 0.397s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-749610f1-b346-474f-8f70-675e0ec9d303" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-749610f1-b346-474f-8f70-675e0ec9d303" released by "delete_volume" :: held 0.656s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['bb2b7887-0514-4a4d-b03a-c61a9c3b6e35', 'c26f693a-f755-43e6-9dc8-4a9dc0942d5a', 'e67ca870-e81c-43fc-8a7f-76d3936ad04d', 'f32582e3-bdc9-41dd-aff5-73fa000d9066'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.094s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-94721027-9560-4494-b462-65da51ca5e0a tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-749610f1-b346-474f-8f70-675e0ec9d303-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-bb903cdc-fd18-404b-aa36-3d7b49044963-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-bb903cdc-fd18-404b-aa36-3d7b49044963-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-bb903cdc-fd18-404b-aa36-3d7b49044963" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-bb903cdc-fd18-404b-aa36-3d7b49044963" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e73b14-e97e-45f0-a949-8d91a5d689e9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:09 devstack quobyte-client[84349]: System call of process 101425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963" returned: 0 in 0.378s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-bb903cdc-fd18-404b-aa36-3d7b49044963" returned: 0 in 0.105s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-bb903cdc-fd18-404b-aa36-3d7b49044963" released by "delete_volume" :: held 0.636s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['d0ae5759-847e-4b4a-98fd-5598bc0bda47', '7f3194f8-57cd-48bf-90fc-9c5091745b44', 'fad9b26c-6b3b-4bfe-9e68-89100df6d0ea', '892efe7a-2a30-4724-a048-2ea809866b94'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.086s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:10 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-bc855c96-e0f9-408a-b863-edae3b7894fe tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-bb903cdc-fd18-404b-aa36-3d7b49044963-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-4f36d6a6-9265-4ab5-a2bd-4d0574e43132-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-4f36d6a6-9265-4ab5-a2bd-4d0574e43132-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:11 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c32e1a-9035-4857-8b2a-0297791dbfd8]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" returned: 0 in 0.388s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" returned: 0 in 0.086s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-4f36d6a6-9265-4ab5-a2bd-4d0574e43132" released by "delete_volume" :: held 0.653s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['cb5f6e69-4d1a-4f79-92bf-d3cd3da75a95', '6087e74f-e2ad-4422-a188-302e3d6b93cf', '1fdf64dd-7d35-4ffc-abd0-92c668752931', '158b2780-03e2-4c1a-9cdb-e310837b3eb2'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.085s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:12 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-504943f0-ce61-4aa8-b3c3-2d3880948aef tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-4f36d6a6-9265-4ab5-a2bd-4d0574e43132-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-a7b66f0b-5c29-4670-8fbf-e27c455e2d93-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-a7b66f0b-5c29-4670-8fbf-e27c455e2d93-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd7840-834e-4cd7-b8e3-2cf3e81d19e7]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:14 devstack quobyte-client[84349]: System call of process 101435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" returned: 0 in 0.380s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-a7b66f0b-5c29-4670-8fbf-e27c455e2d93" released by "delete_volume" :: held 0.643s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['8dc1be30-4f6e-4618-b7ee-c07a5600872c', '67878a46-dab1-4fa8-907f-742133a1fca2', 'c457834a-1b92-4500-bc01-dda09785b0dc', 'abd14cbb-48bb-4a15-9827-3e826d165144'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:14 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:14 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-adf327df-77a6-4c5d-9559-567b632f1499 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-a7b66f0b-5c29-4670-8fbf-e27c455e2d93-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-f6253cca-4876-4ca6-9d91-d86c0a670467-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-f6253cca-4876-4ca6-9d91-d86c0a670467-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:15 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-f6253cca-4876-4ca6-9d91-d86c0a670467" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-f6253cca-4876-4ca6-9d91-d86c0a670467" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[8826fcd7-01f7-4947-936c-1baafd3153d9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467" returned: 0 in 0.396s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-f6253cca-4876-4ca6-9d91-d86c0a670467" returned: 0 in 0.087s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-f6253cca-4876-4ca6-9d91-d86c0a670467" released by "delete_volume" :: held 0.635s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:16 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['996dcc94-a644-4db2-8d9c-8a3743385298', '6a87d522-2a8c-4753-8fa6-d4b3ec834c1b', '08bf21fe-8173-45c1-aeef-276d1cba1185', 'f08859da-cbc0-45b7-90e5-a46ec6603519'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:17 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1c955c18-c0cf-4426-bedf-c45bb567c93f tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-f6253cca-4876-4ca6-9d91-d86c0a670467-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-fb08b151-6867-4697-b700-39a04eac4a37-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-fb08b151-6867-4697-b700-39a04eac4a37-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:18 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "cinder-quobyte-fb08b151-6867-4697-b700-39a04eac4a37" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-fb08b151-6867-4697-b700-39a04eac4a37" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0fc844-6aaf-45ec-a90a-4ca793793697]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37" returned: 0 in 0.392s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb08b151-6867-4697-b700-39a04eac4a37" returned: 0 in 0.086s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-quobyte-fb08b151-6867-4697-b700-39a04eac4a37" released by "delete_volume" :: held 0.641s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Created reservations ['27e0d8f3-ee15-4f48-a97b-d7db23671851', 'a6855452-aeb7-4ae0-b0f3-2ac7d0f4f86c', 'a4c1a39b-2a2a-44e0-821c-da9aeadf8897', 'b7c9e38e-a193-4d88-a9fb-05fd7a6feb93'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.080s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Deleted volume successfully. Sep 25 21:47:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-da40bbeb-79a3-4ac7-b5d8-d433225c08f1 tempest-CreateVolumesFromSourceVolumeTest-1683125629 None] Lock "cinder-fb08b151-6867-4697-b700-39a04eac4a37-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Flow 'volume_create_manager' (bd707c00-2ebe-4ddb-98bb-d2b87fc22b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db33e6d-f130-41e8-b38f-dc4b0190c03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db33e6d-f130-41e8-b38f-dc4b0190c03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7c768a-a7d9-41b3-9037-607734f88fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ce7edb36e446d4b514ffe9ee6be651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:23Z,use_quota=True,user_id='8b1f61253811483ea903fc4b71b1b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b419285f-2c7c-4d1a-8e2a-a6c0874f9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b419285f-2c7c-4d1a-8e2a-a6c0874f9fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c171f20b-1466-444d-b3c6-4529882d8331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c171f20b-1466-444d-b3c6-4529882d8331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7c768a-a7d9-41b3-9037-607734f88fff', 'volume_name': 'volume-4e7c768a-a7d9-41b3-9037-607734f88fff', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5926bd5-5563-42db-abaa-e4beae42921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5926bd5-5563-42db-abaa-e4beae42921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e264681a-dafb-47d0-b672-7c3c44937e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:23 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Volume 4e7c768a-a7d9-41b3-9037-607734f88fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7c768a-a7d9-41b3-9037-607734f88fff', 'volume_size': 1} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7c768a-a7d9-41b3-9037-607734f88fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ce7edb36e446d4b514ffe9ee6be651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:23Z,use_quota=True,user_id='8b1f61253811483ea903fc4b71b1b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Creating volume 4e7c768a-a7d9-41b3-9037-607734f88fff {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:23 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:23 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=142, name=volume-4e7c768a-a7d9-41b3-9037-607734f88fff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff 1073741824" returned: 0 in 0.313s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff" returned: 0 in 0.081s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] <== create_volume: return (456ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.470s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:23 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e264681a-dafb-47d0-b672-7c3c44937e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7c768a-a7d9-41b3-9037-607734f88fff', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b68ba9-d669-4245-a828-0e1f503e4bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:24 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Volume volume-4e7c768a-a7d9-41b3-9037-607734f88fff (4e7c768a-a7d9-41b3-9037-607734f88fff): created successfully Sep 25 21:47:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b68ba9-d669-4245-a828-0e1f503e4bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Flow 'volume_create_manager' (bd707c00-2ebe-4ddb-98bb-d2b87fc22b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f121cc0c-2f20-4b19-adfc-d25a52beaa54 tempest-CinderUnicodeTest-1523516366 None] Created volume successfully. Sep 25 21:47:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Flow 'volume_create_manager' (36c9b902-37c6-45c3-85a4-1edd94c2b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20aac17-11a1-4ba2-889a-fc1bd5162b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20aac17-11a1-4ba2-889a-fc1bd5162b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-291836111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67177b6b-c472-4bd2-9a7a-c0ea0465d1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ce7edb36e446d4b514ffe9ee6be651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:26Z,use_quota=True,user_id='8b1f61253811483ea903fc4b71b1b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123f82da-92b5-4481-8d61-3bf85a0bb8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123f82da-92b5-4481-8d61-3bf85a0bb8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0378085-b4c2-4296-9926-80ae9b6f8f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0378085-b4c2-4296-9926-80ae9b6f8f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67177b6b-c472-4bd2-9a7a-c0ea0465d1d1', 'volume_name': 'volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae01432d-7761-453b-a9d7-9afc63e5bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae01432d-7761-453b-a9d7-9afc63e5bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c9ed7-a718-4e90-8d2e-d5eab47aa2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:25 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Volume 67177b6b-c472-4bd2-9a7a-c0ea0465d1d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1', 'volume_size': 1} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-291836111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67177b6b-c472-4bd2-9a7a-c0ea0465d1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ce7edb36e446d4b514ffe9ee6be651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:26Z,use_quota=True,user_id='8b1f61253811483ea903fc4b71b1b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Creating volume 67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:25 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:25 devstack quobyte-client[84349]: System call of process 101456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:25 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=143, name=volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 1073741824" returned: 0 in 0.316s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" returned: 0 in 0.087s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c9ed7-a718-4e90-8d2e-d5eab47aa2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb9742f-4097-40ff-994b-bdb1fcb62b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:26 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Volume volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 (67177b6b-c472-4bd2-9a7a-c0ea0465d1d1): created successfully Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb9742f-4097-40ff-994b-bdb1fcb62b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Flow 'volume_create_manager' (36c9b902-37c6-45c3-85a4-1edd94c2b884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-495ea9ea-e7f6-48c3-9211-76aa00229d36 tempest-CinderUnicodeTest-1523516366 None] Created volume successfully. Sep 25 21:47:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Creating offline snapshot 594e31d1-ed79-460e-a551-a005906e3749 of volume 67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7738c8e-b336-4b59-a1b8-bdadca5c8273]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:27 devstack quobyte-client[84349]: System call of process 101460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" returned: 0 in 0.470s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:27 devstack quobyte-client[84349]: System call of process 101484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:27 devstack quobyte-client[84349]: System call of process 101484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:27 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=144, name=volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 1G" returned: 0 in 0.328s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:28 devstack quobyte-client[84349]: System call of process 101496 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "qemu-img rebase -u -b volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.175s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.103s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.107s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.info" returned: 0 in 0.093s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.info" returned: 0 in 0.082s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.741s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-55d245e1-efc3-4984-8a9c-20e6720872ed tempest-CinderUnicodeTest-1523516366 None] Create snapshot completed successfully Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-594e31d1-ed79-460e-a551-a005906e3749-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-594e31d1-ed79-460e-a551-a005906e3749-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:30 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-quobyte-594e31d1-ed79-460e-a551-a005906e3749" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-594e31d1-ed79-460e-a551-a005906e3749" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Deleting offline snapshot 594e31d1-ed79-460e-a551-a005906e3749 of volume 67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] snapshot_file for this snap is: volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[85741c4c-414d-4fef-8862-407686bb865b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:30 devstack quobyte-client[84349]: System call of process 101507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:30 devstack quobyte-client[84349]: System call of process 101507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.395s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281c155-31d0-4938-b1fd-17cc6d77863b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:31 devstack quobyte-client[84349]: System call of process 101510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:31 devstack quobyte-client[84349]: System call of process 101510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:31 devstack quobyte-client[84349]: System call of process 101510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:31 devstack quobyte-client[84349]: System call of process 101510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" returned: 0 in 0.479s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:31 devstack quobyte-client[84349]: System call of process 101513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.242s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1.594e31d1-ed79-460e-a551-a005906e3749" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-594e31d1-ed79-460e-a551-a005906e3749" released by "_delete_snapshot" :: held 1.563s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" released by "delete_snapshot" :: held 1.583s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Created reservations ['505fa53a-5696-485c-8e85-50127092296d', 'edc326ef-a89c-4637-80dd-e8fcad9638ed', 'c77d4fe0-7b89-4504-98ab-69bffab0393c', 'bbb8e532-165d-4be9-9b10-eb1f584f2465'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:32 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Delete snapshot completed successfully. Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-32343a6d-400d-442d-89a7-446d181acdd9 tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-594e31d1-ed79-460e-a551-a005906e3749-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:32 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" acquired by "delete_volume" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9703e-cec9-4c62-aeb5-7cc5c40624e4]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:32 devstack quobyte-client[84349]: System call of process 101517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" returned: 0 in 0.420s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" returned: 0 in 0.113s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1" released by "delete_volume" :: held 0.695s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Created reservations ['c64b5c6e-1ff7-4836-954a-72dcebcb2743', '3b2c2fe7-9c7b-4722-884a-104446d8a9c6', 'c088dc52-01c0-4329-a1d4-e7961ad3cfc6', 'f21939c2-ec8d-4200-9a43-d8fc0c8c0b36'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.108s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:33 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Deleted volume successfully. Sep 25 21:47:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-46155274-d0ec-4723-b703-c6b1e01c019e tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-67177b6b-c472-4bd2-9a7a-c0ea0465d1d1-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-4e7c768a-a7d9-41b3-9037-607734f88fff-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-4e7c768a-a7d9-41b3-9037-607734f88fff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "cinder-quobyte-4e7c768a-a7d9-41b3-9037-607734f88fff" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-4e7c768a-a7d9-41b3-9037-607734f88fff" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b6ef0-f8ed-4ade-95d0-51107a314e38]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:47:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff" returned: 0 in 0.383s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4e7c768a-a7d9-41b3-9037-607734f88fff" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-quobyte-4e7c768a-a7d9-41b3-9037-607734f88fff" released by "delete_volume" :: held 0.644s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Created reservations ['2ff76b2d-8f39-4c1a-ad77-deb8811f3618', '7c20495a-aa55-4f9b-b00e-363ac11aae4a', 'ff00413f-ba5f-43f2-bddb-b6a5f18c4a1d', 'da3b5866-c4b3-4a7a-9898-f32715a526ad'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.100s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:36 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Deleted volume successfully. Sep 25 21:47:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-7055e89d-beed-46c5-ba89-8cf91d0aeeae tempest-CinderUnicodeTest-1523516366 None] Lock "cinder-4e7c768a-a7d9-41b3-9037-607734f88fff-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.132s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:40 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:47:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=62,cinder:UPDATE=104,cinder:DELETE=6,cinder:INSERT=22 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:47:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=70,cinder:SELECT=47,cinder:DELETE=11,cinder:INSERT=14 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:47:54 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (97704a22-52e0-4941-b458-2a55cf602be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d856ac-4ee6-480a-866a-42453692f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d856ac-4ee6-480a-866a-42453692f978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436698036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e01a33-b833-42dc-98a9-c179403cbfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:54Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f19fd1-89bf-4897-98ce-109316d6086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f19fd1-89bf-4897-98ce-109316d6086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee145324-5e03-4e81-b2bd-b3eb6b9bcb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee145324-5e03-4e81-b2bd-b3eb6b9bcb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e01a33-b833-42dc-98a9-c179403cbfd1', 'volume_name': 'volume-68e01a33-b833-42dc-98a9-c179403cbfd1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc818e9d-7766-4145-8ad7-7a86f38f03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc818e9d-7766-4145-8ad7-7a86f38f03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab735f4-af4f-4acd-aa44-84fee7d01b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:54 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume 68e01a33-b833-42dc-98a9-c179403cbfd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e01a33-b833-42dc-98a9-c179403cbfd1', 'volume_size': 1} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436698036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e01a33-b833-42dc-98a9-c179403cbfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:54Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Creating volume 68e01a33-b833-42dc-98a9-c179403cbfd1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:54 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:55 devstack quobyte-client[84349]: System call of process 101585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:55 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=146, name=volume-68e01a33-b833-42dc-98a9-c179403cbfd1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:55 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Flow 'volume_create_manager' (e251c563-87f5-436f-affc-769495d15e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189ae531-b16c-4c83-9501-487e0bb098a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189ae531-b16c-4c83-9501-487e0bb098a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d88577-27bb-43cc-9042-828844eaafe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d31f1d3de0499e8adb70688d2bdb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='b40a7d5836a246209071799801995f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5429ba-958d-4f19-958e-5dcc9bbcbd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5429ba-958d-4f19-958e-5dcc9bbcbd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f32e50-9731-4381-a7e3-877c350d55bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f32e50-9731-4381-a7e3-877c350d55bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d88577-27bb-43cc-9042-828844eaafe5', 'volume_name': 'volume-04d88577-27bb-43cc-9042-828844eaafe5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a02e569-fb12-412c-8630-7957c7cf34c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a02e569-fb12-412c-8630-7957c7cf34c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4061c8c-4691-4349-a038-35bf49a5a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:55 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Volume 04d88577-27bb-43cc-9042-828844eaafe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d88577-27bb-43cc-9042-828844eaafe5', 'volume_size': 1} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1 1073741824" returned: 0 in 0.956s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (a8c8179f-9b9f-4234-bc49-8b4ee520ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c20c05-89fa-4c03-a7a7-5066974b0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (712e2ec7-efde-44b4-8b0c-f963a5b00593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcb129-dbc9-40ed-8efe-9c5e90352db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcb129-dbc9-40ed-8efe-9c5e90352db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1394509156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb1b17e-6c8c-42a3-98de-7dce74bca407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2921e2c4-e24e-4c98-9470-9c0f8d885ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2921e2c4-e24e-4c98-9470-9c0f8d885ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653bc9d6-db8b-4357-8843-77654d99a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653bc9d6-db8b-4357-8843-77654d99a871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb1b17e-6c8c-42a3-98de-7dce74bca407', 'volume_name': 'volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe16cb0-66fb-4150-b2c6-580ba43e2be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe16cb0-66fb-4150-b2c6-580ba43e2be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ec130f-a0d8-4efe-97b0-3edfe74c2359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Volume 2cb1b17e-6c8c-42a3-98de-7dce74bca407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407', 'volume_size': 1} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c20c05-89fa-4c03-a7a7-5066974b0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001648561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17233595-08c5-4eb3-9221-774c705d9de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17233595-08c5-4eb3-9221-774c705d9de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364a45fc-3f26-4827-9b1c-b690b2b8b58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364a45fc-3f26-4827-9b1c-b690b2b8b58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee', 'volume_name': 'volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27aebc12-dbf6-422d-bd2b-478c049066f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27aebc12-dbf6-422d-bd2b-478c049066f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53162c16-5fe3-4ff3-a69a-9b214dd7a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Volume b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee', 'volume_size': 1} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (baa99a35-ac4f-4d38-81ce-b26932b5f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8be17a7-00e5-4ed9-a763-64b69b5e5743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1" returned: 0 in 0.863s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (dfbc597e-d568-418d-922f-9064f37a96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb9512-3297-44d2-bb6a-325ddedd7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] <== create_volume: return (1884ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d88577-27bb-43cc-9042-828844eaafe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d31f1d3de0499e8adb70688d2bdb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='b40a7d5836a246209071799801995f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Creating volume 04d88577-27bb-43cc-9042-828844eaafe5 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:56 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:57 devstack quobyte-client[84349]: System call of process 101589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb9512-3297-44d2-bb6a-325ddedd7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840930272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b6d604-86e4-4055-b67d-8233b2ba60f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:56Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=147, name=volume-04d88577-27bb-43cc-9042-828844eaafe5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7766dc2d-9160-46d5-bb9c-55b369462814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7766dc2d-9160-46d5-bb9c-55b369462814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b7999f-dccd-41c0-b018-4b681844bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b7999f-dccd-41c0-b018-4b681844bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b6d604-86e4-4055-b67d-8233b2ba60f4', 'volume_name': 'volume-66b6d604-86e4-4055-b67d-8233b2ba60f4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cb7e90-60cd-471f-8e6c-f4d72f25d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cb7e90-60cd-471f-8e6c-f4d72f25d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a393a4-f363-4491-8cba-5c69121822ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume 66b6d604-86e4-4055-b67d-8233b2ba60f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b6d604-86e4-4055-b67d-8233b2ba60f4', 'volume_size': 1} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8be17a7-00e5-4ed9-a763-64b69b5e5743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497331516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c91d2c8-c23b-4fcf-8e24-6526aaed59b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:56Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e8ea10-143e-421a-a4a4-cb76f6d0e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e8ea10-143e-421a-a4a4-cb76f6d0e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27664faa-e5dd-484f-bc54-b4bf865b1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27664faa-e5dd-484f-bc54-b4bf865b1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c91d2c8-c23b-4fcf-8e24-6526aaed59b8', 'volume_name': 'volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea4a93f-51af-41e7-9f7e-d8796d085e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea4a93f-51af-41e7-9f7e-d8796d085e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a605a72-8299-43e5-8fa1-dc1e717037a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Volume 2c91d2c8-c23b-4fcf-8e24-6526aaed59b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8', 'volume_size': 1} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab735f4-af4f-4acd-aa44-84fee7d01b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e01a33-b833-42dc-98a9-c179403cbfd1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66721886-e4f1-438c-a225-741f9162ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5 1073741824" returned: 0 in 0.570s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:57 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume volume-68e01a33-b833-42dc-98a9-c179403cbfd1 (68e01a33-b833-42dc-98a9-c179403cbfd1): created successfully Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66721886-e4f1-438c-a225-741f9162ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (97704a22-52e0-4941-b458-2a55cf602be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:57 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d0e4452d-7703-4333-b784-d1f3ec9614c7 tempest-CreateVolumesFromImageTest-1177632860 None] Created volume successfully. Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5" returned: 0 in 0.424s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] <== create_volume: return (1019ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1394509156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb1b17e-6c8c-42a3-98de-7dce74bca407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Creating volume 2cb1b17e-6c8c-42a3-98de-7dce74bca407 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:57 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:58 devstack quobyte-client[84349]: System call of process 101593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:47:58 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=148, name=volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Flow 'volume_create_manager' (bd7db397-296d-4981-8d39-afcf6b811353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e67924f-14d0-4f29-b5a8-a1ae528b3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4061c8c-4691-4349-a038-35bf49a5a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d88577-27bb-43cc-9042-828844eaafe5', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca4ddf1-d14d-4f0f-937c-36ad47bf77f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e67924f-14d0-4f29-b5a8-a1ae528b3c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e87d61e-c996-4193-9e7a-03403e2d44f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4945348b1d4c47a2ea4314752808a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:58Z,use_quota=True,user_id='8c660d3d633442aeb2fc9c1d2ff14db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874203de-0d4e-40f3-a063-ec3e22754977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874203de-0d4e-40f3-a063-ec3e22754977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c1a0af-3ac6-4efe-b688-f82f5529239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.image.glance [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Creating Keystone auth plugin from conf {{(pid=84334) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 1073741824" returned: 0 in 0.651s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:58 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Volume volume-04d88577-27bb-43cc-9042-828844eaafe5 (04d88577-27bb-43cc-9042-828844eaafe5): created successfully Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca4ddf1-d14d-4f0f-937c-36ad47bf77f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Flow 'volume_create_manager' (e251c563-87f5-436f-affc-769495d15e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:47:58 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-99030f89-2309-42ff-a85b-e7bf388d40a5 tempest-CinderUnicodeTest-219949987 None] Created volume successfully. Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407" returned: 0 in 0.420s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001648561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:55Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Creating volume b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:47:59 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:47:59 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=149, name=volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ec130f-a0d8-4efe-97b0-3edfe74c2359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22445f7-2a77-44e9-b0fc-98f7e446b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee 1073741824" returned: 0 in 0.550s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:47:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Volume volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 (2cb1b17e-6c8c-42a3-98de-7dce74bca407): created successfully Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22445f7-2a77-44e9-b0fc-98f7e446b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (712e2ec7-efde-44b4-8b0c-f963a5b00593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" returned: 0 in 0.551s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] <== create_volume: return (1132ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c1a0af-3ac6-4efe-b688-f82f5529239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e87d61e-c996-4193-9e7a-03403e2d44f7', 'volume_name': 'volume-2e87d61e-c996-4193-9e7a-03403e2d44f7', 'volume_size': 1, 'image_id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79e1ca258045def5659e3498b23100fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b4945348b1d4c47a2ea4314752808a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08f306cdaccf57459fc2795ea974d1d05b31b3354f789513b61bb3d3efb2e82b2a792b140b0d59e3f1af45e4458ae1f50619e0168d6ba2613a60c422c9cbfdca', 'id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'created_at': datetime.datetime(2025, 9, 25, 19, 47, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289f4ceb-0681-48c9-80b0-13bca56be78a/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3604bc-3ca6-4d5a-8d06-1fe80c88bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3604bc-3ca6-4d5a-8d06-1fe80c88bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09891484-3b8b-46e1-a94b-790fb494d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Volume 2e87d61e-c996-4193-9e7a-03403e2d44f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e87d61e-c996-4193-9e7a-03403e2d44f7', 'volume_size': 1, 'image_id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79e1ca258045def5659e3498b23100fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b4945348b1d4c47a2ea4314752808a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08f306cdaccf57459fc2795ea974d1d05b31b3354f789513b61bb3d3efb2e82b2a792b140b0d59e3f1af45e4458ae1f50619e0168d6ba2613a60c422c9cbfdca', 'id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'created_at': datetime.datetime(2025, 9, 25, 19, 47, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289f4ceb-0681-48c9-80b0-13bca56be78a/file', 'properties': {}}, 'image_service': } Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Cloning 2e87d61e-c996-4193-9e7a-03403e2d44f7 from image 289f4ceb-0681-48c9-80b0-13bca56be78a at location (None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}]). {{(pid=84334) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.050s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840930272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b6d604-86e4-4055-b67d-8233b2ba60f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:56Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Creating volume 66b6d604-86e4-4055-b67d-8233b2ba60f4 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:00 devstack quobyte-client[84349]: System call of process 101601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:00 devstack quobyte-client[84349]: System call of process 101601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:00 devstack quobyte-client[84349]: System call of process 101601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:00 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=150, name=volume-66b6d604-86e4-4055-b67d-8233b2ba60f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-792670f7-b855-4178-bf7a-128f88fab695 tempest-CreateVolumesFromImageTest-1177632860 None] Created volume successfully. Sep 25 21:48:00 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Flow 'volume_create_manager' (044156d1-0b27-4028-ba52-174ad1faa774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0a6f2c-0c9b-43c8-8210-0445b4983cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0a6f2c-0c9b-43c8-8210-0445b4983cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-63949476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0528e7-b8e7-470b-a123-615de6925942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d31f1d3de0499e8adb70688d2bdb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:00Z,use_quota=True,user_id='b40a7d5836a246209071799801995f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec230e8b-316e-4079-8311-c4abbaf96155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec230e8b-316e-4079-8311-c4abbaf96155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56de55-8b7f-4030-9d1b-cb62671a3078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56de55-8b7f-4030-9d1b-cb62671a3078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0528e7-b8e7-470b-a123-615de6925942', 'volume_name': 'volume-fb0528e7-b8e7-470b-a123-615de6925942', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ad2c1c-d4d6-47d5-b1bd-f51f3695878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ad2c1c-d4d6-47d5-b1bd-f51f3695878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3787073-5f8e-4078-b9ef-f6a614d9b8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Volume fb0528e7-b8e7-470b-a123-615de6925942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0528e7-b8e7-470b-a123-615de6925942', 'volume_size': 1} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53162c16-5fe3-4ff3-a69a-9b214dd7a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcf085-00e1-4416-a762-05c81e36de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:701}} Sep 25 21:48:00 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 1073741824" returned: 0 in 0.691s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Volume volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee (b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee): created successfully Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcf085-00e1-4416-a762-05c81e36de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (a8c8179f-9b9f-4234-bc49-8b4ee520ca04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4" returned: 0 in 0.377s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497331516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c91d2c8-c23b-4fcf-8e24-6526aaed59b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82d2b4e14c04d91939ef00dc52b1cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:56Z,use_quota=True,user_id='04936830988d43d5825c64e5dd3fa54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Creating volume 2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:01 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:01 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-d72f678b-4209-4904-b234-f2a68f79e27c tempest-CreateVolumesFromImageTest-1177632860 None] Created volume successfully. Sep 25 21:48:01 devstack quobyte-client[84349]: System call of process 101605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:01 devstack quobyte-client[84349]: System call of process 101605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:01 devstack quobyte-client[84349]: System call of process 101605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:01 devstack quobyte-client[84349]: System call of process 101605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:01 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=151, name=volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ce084-dc9b-4b91-8fc7-bac01459f667]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a393a4-f363-4491-8cba-5c69121822ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b6d604-86e4-4055-b67d-8233b2ba60f4', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dccbf2-e9d0-4e87-9d93-4c84f2f12102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Volume volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 (66b6d604-86e4-4055-b67d-8233b2ba60f4): created successfully Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dccbf2-e9d0-4e87-9d93-4c84f2f12102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (dfbc597e-d568-418d-922f-9064f37a96da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 1073741824" returned: 0 in 0.837s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:02 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD Sep 25 21:48:02 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" returned: 0 in 0.169s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4ae961be-bd49-43c6-a081-1dd4e32d32b7 tempest-CreateVolumesFromImageTest-1177632860 None] Created volume successfully. Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] <== create_volume: return (1179ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-63949476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0528e7-b8e7-470b-a123-615de6925942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d31f1d3de0499e8adb70688d2bdb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:00Z,use_quota=True,user_id='b40a7d5836a246209071799801995f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Creating volume fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:02 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:02 devstack quobyte-client[84349]: System call of process 101611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:02 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=152, name=volume-fb0528e7-b8e7-470b-a123-615de6925942, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a605a72-8299-43e5-8fa1-dc1e717037a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355e6000-a2a5-4746-b06b-9129e5fb64b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 1073741824" returned: 0 in 0.629s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Volume volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 (2c91d2c8-c23b-4fcf-8e24-6526aaed59b8): created successfully Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355e6000-a2a5-4746-b06b-9129e5fb64b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Flow 'volume_create_manager' (baa99a35-ac4f-4d38-81ce-b26932b5f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942" returned: 0 in 0.420s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7ba05743-3a58-4af8-9bba-2ed03b5a2068 tempest-CreateVolumesFromImageTest-1177632860 None] Created volume successfully. Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3787073-5f8e-4078-b9ef-f6a614d9b8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0528e7-b8e7-470b-a123-615de6925942', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90bcb21-5198-4a08-bf9c-98d145e8fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:03 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Volume volume-fb0528e7-b8e7-470b-a123-615de6925942 (fb0528e7-b8e7-470b-a123-615de6925942): created successfully Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90bcb21-5198-4a08-bf9c-98d145e8fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:03 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Flow 'volume_create_manager' (044156d1-0b27-4028-ba52-174ad1faa774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:03 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-fc249762-ad9f-4a4f-8743-912e97e62827 tempest-CinderUnicodeTest-219949987 None] Created volume successfully. Sep 25 21:48:04 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 0 in 2.736s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8-delete_volume" acquired by "delete_volume" :: waited 0.297s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:05 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD Sep 25 21:48:05 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Creating offline snapshot 53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 of volume fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b216f08-4567-41c5-a433-b5fa666cb623]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:05 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-quobyte-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" acquired by "delete_volume" :: waited 0.125s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[02083b6b-7657-490f-a684-f65c1e8ba4f9]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942" returned: 0 in 0.747s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=153, name=volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 1G" returned: 0 in 0.307s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): qemu-img rebase -u -b volume-fb0528e7-b8e7-470b-a123-615de6925942 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" returned: 0 in 0.762s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack quobyte-client[84349]: System call of process 101629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "qemu-img rebase -u -b volume-fb0528e7-b8e7-470b-a123-615de6925942 -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.321s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" returned: 0 in 0.348s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8" released by "delete_volume" :: held 1.446s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.543s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:07 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 1 in 3.202s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Temporary image 289f4ceb-0681-48c9-80b0-13bca56be78a is fetched for user 8c660d3d633442aeb2fc9c1d2ff14db8. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1402}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.472s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.info" returned: 0 in 0.399s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Created reservations ['1266ae57-768a-4607-81c2-f8e1771b3887', '773617dc-f476-4a25-9f81-58de771ee6e4', 'e7214871-2f6f-4883-afe8-0b5c29254494', 'be455a28-1b26-43eb-9e70-69769ad7ee9b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.info" returned: 0 in 0.386s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80c7ac2-f6e5-4af6-bb20-b0a787240492]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-62423869-7d1d-41c9-a318-28a6b657ce88 tempest-CinderUnicodeTest-219949987 None] Create snapshot completed successfully Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:09 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD Sep 25 21:48:09 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-66b6d604-86e4-4055-b67d-8233b2ba60f4-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.469s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:09 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Deleted volume successfully. Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.272s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-66b6d604-86e4-4055-b67d-8233b2ba60f4-delete_volume" acquired by "delete_volume" :: waited 0.236s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" acquired by "delete_snapshot" :: waited 0.128s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-quobyte-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-f7f9e8b4-a5ea-4435-b90a-76922425e8fd tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-2c91d2c8-c23b-4fcf-8e24-6526aaed59b8-delete_volume" released by "delete_volume" :: held 4.886s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:09 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-quobyte-66b6d604-86e4-4055-b67d-8233b2ba60f4" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:09 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Deleting offline snapshot 53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 of volume fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] snapshot_file for this snap is: volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-66b6d604-86e4-4055-b67d-8233b2ba60f4" acquired by "delete_volume" :: waited 0.054s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b93de-3877-46a4-96d3-dfd11d2428d5]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2786d-0d99-49d5-b8a3-b8d543bd7b52]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:10 devstack quobyte-client[84349]: System call of process 101643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.668s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb0528e7-b8e7-470b-a123-615de6925942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:48:10 devstack quobyte-client[84349]: System call of process 101644 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b911081-c7d3-491e-8524-7c01c35feb10]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:10 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4" returned: 0 in 0.804s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-66b6d604-86e4-4055-b67d-8233b2ba60f4" returned: 0 in 0.190s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-66b6d604-86e4-4055-b67d-8233b2ba60f4" released by "delete_volume" :: held 1.453s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:11 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 0 in 3.081s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:11 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942" returned: 0 in 1.149s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:12 devstack quobyte-client[84349]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:12 devstack quobyte-client[84349]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:12 devstack quobyte-client[84349]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:12 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD Sep 25 21:48:12 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.372s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Created reservations ['d8ab01fd-4d90-4295-8f4d-8269a25b3c14', 'f8f9438d-d367-4bb1-8254-9acb7aae30e8', 'faa3c071-72ca-4961-9100-be0c7fda909a', 'b2e6f308-080a-4774-8b8a-e69d70396641'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942.53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" returned: 0 in 0.393s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3" released by "_delete_snapshot" :: held 2.969s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:12 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" released by "delete_snapshot" :: held 3.072s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.209s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Deleted volume successfully. Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Created reservations ['e18449c7-ff41-4e07-8c73-cb98279bac89', '76582e20-0a92-4c64-b556-597db5aff13a', 'bcc22aca-5d44-4ede-9c3a-92e9931fa691', 'c507a6ee-d632-4ddb-b159-bb1d2a84ce7b'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-06fb0f74-87cd-4377-9d04-7a24cdd598bf tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-66b6d604-86e4-4055-b67d-8233b2ba60f4-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:13 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Delete snapshot completed successfully. Sep 25 21:48:13 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-63dafd50-524e-4bc3-ae60-a0a4062957ba tempest-CinderUnicodeTest-219949987 None] Lock "cinder-53ccc9ec-c0ea-4b44-b0d4-24ca52c6dff3-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-quobyte-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" acquired by "delete_volume" :: waited 0.023s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd646ee1-57ea-4f22-b089-ee416a126cdd]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:14 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 1 in 2.845s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e87d61e-c996-4193-9e7a-03403e2d44f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4945348b1d4c47a2ea4314752808a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:47:58Z,use_quota=True,user_id='8c660d3d633442aeb2fc9c1d2ff14db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Creating volume 2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:14 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:14 devstack quobyte-client[84349]: System call of process 101667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:14 devstack quobyte-client[84349]: System call of process 101667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:14 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=155, name=volume-2e87d61e-c996-4193-9e7a-03403e2d44f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:14 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-fb0528e7-b8e7-470b-a123-615de6925942-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:15 devstack quobyte-client[84349]: System call of process 101665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "cinder-fb0528e7-b8e7-470b-a123-615de6925942-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 1073741824" returned: 0 in 0.564s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" returned: 0 in 1.258s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:15 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 0 in 0.563s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] <== create_volume: return (1200ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" returned: 0 in 0.362s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" acquired by "delete_volume" :: waited 0.220s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb611a-e983-4b9c-9358-be74f39876b6]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee" released by "delete_volume" :: held 1.928s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Attempting download of 289f4ceb-0681-48c9-80b0-13bca56be78a ((None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}])) to volume 2e87d61e-c996-4193-9e7a-03403e2d44f7. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Created reservations ['d781f8f0-76ce-4dc2-ad2f-a0f60ecc1ad9', 'f876f1cc-257b-4449-9414-8acacfb2718f', 'f0b4d889-0064-47c2-b5f9-491ffadf0c86', '97531894-f855-476e-bece-bea5bc4980c4'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480c6d2-5b9f-416e-94c4-38e40e72bffc]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_289f4ceb-0681-48c9-80b0-13bca56be78a_jz50cp7u {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942" returned: 0 in 0.967s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-fb0528e7-b8e7-470b-a123-615de6925942" returned: 0 in 0.213s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_289f4ceb-0681-48c9-80b0-13bca56be78a_jz50cp7u" returned: 0 in 0.659s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289f4ceb-0681-48c9-80b0-13bca56be78a_jz50cp7u {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-fb0528e7-b8e7-470b-a123-615de6925942" released by "delete_volume" :: held 1.582s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-2cb1b17e-6c8c-42a3-98de-7dce74bca407-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289f4ceb-0681-48c9-80b0-13bca56be78a_jz50cp7u" returned: 1 in 0.958s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289f4ceb-0681-48c9-80b0-13bca56be78a_jz50cp7u' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-2cb1b17e-6c8c-42a3-98de-7dce74bca407-delete_volume" acquired by "delete_volume" :: waited 0.512s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d996c-3e58-4eb5-ab56-375ba571cb47]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Created reservations ['27175a86-7e55-4c3e-b3f6-cdc96640cfc7', 'aa46e94a-3bd5-49a2-a514-9b208e4128c0', 'a1ad3617-f518-4197-8509-57951338172b', 'c26e583e-234d-46c2-82ef-e6459d8cf7c4'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.793s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Deleted volume successfully. Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-04d88577-27bb-43cc-9042-828844eaafe5-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:19 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-quobyte-2cb1b17e-6c8c-42a3-98de-7dce74bca407" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1dfbbf3a-d55a-4ebb-afa6-a984f67fe32e tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-b7aa76e6-d0c3-4cf2-9a3a-31b47d22d3ee-delete_volume" released by "delete_volume" :: held 5.627s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.711s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Deleted volume successfully. Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "cinder-04d88577-27bb-43cc-9042-828844eaafe5-delete_volume" acquired by "delete_volume" :: waited 0.242s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-2cb1b17e-6c8c-42a3-98de-7dce74bca407" acquired by "delete_volume" :: waited 0.206s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4bdce2-5fd3-41cc-80b2-fb426480d176]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4534e902-5ce2-4b61-a504-5f88bdd3b17a tempest-CinderUnicodeTest-219949987 None] Lock "cinder-fb0528e7-b8e7-470b-a123-615de6925942-delete_volume" released by "delete_volume" :: held 5.129s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD" returned: 1 in 0.970s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] 289f4ceb-0681-48c9-80b0-13bca56be78a was raw, converting to raw {{(pid=84334) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1089}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:20 devstack quobyte-client[84349]: System call of process 101690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:20 devstack quobyte-client[84349]: System call of process 101690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:20 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=155, name=volume-2e87d61e-c996-4193-9e7a-03403e2d44f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:20 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "cinder-quobyte-04d88577-27bb-43cc-9042-828844eaafe5" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 0 in 0.399s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_289f4ceb-0681-48c9-80b0-13bca56be78a_p1iqajqbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:48:20 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407" returned: 0 in 0.881s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-04d88577-27bb-43cc-9042-828844eaafe5" acquired by "delete_volume" :: waited 0.391s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2cb1b17e-6c8c-42a3-98de-7dce74bca407" returned: 0 in 0.189s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 1G" returned: 0 in 0.419s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c7f9c2-192b-4715-9a42-e219c9ad7941]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-2cb1b17e-6c8c-42a3-98de-7dce74bca407" released by "delete_volume" :: held 1.436s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[52da4d73-438c-4534-839b-7152fa40a918]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:21 devstack quobyte-client[84349]: System call of process 101700 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:21 devstack quobyte-client[84349]: System call of process 101700 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5" returned: 0 in 0.753s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-04d88577-27bb-43cc-9042-828844eaafe5" returned: 0 in 0.254s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:22 devstack quobyte-client[84349]: System call of process 101701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Created reservations ['fdad3211-7ec0-49a4-9e37-91c7efa64c94', '8e723d53-7c66-43ce-9aaf-9b2b88b40940', '6b6d24ef-1b7e-41da-8484-754f4abe09b4', 'c87da3f2-2a92-4c74-9ab3-bf62979ed290'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "cinder-quobyte-04d88577-27bb-43cc-9042-828844eaafe5" released by "delete_volume" :: held 1.300s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 0 in 0.959s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:22 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:23 devstack quobyte-client[84349]: System call of process 101706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-68e01a33-b833-42dc-98a9-c179403cbfd1-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 1 in 0.895s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Created reservations ['ac8dc8b8-ed97-4b1c-9cc9-1ea2a41abfc0', '911973e6-2c52-421c-801c-2d803fab8327', 'e3950c78-fd20-4113-8ba1-8e1e4393a4a2', 'd15bb15c-053c-4949-ae8b-ccd75aadd149'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Downloaded image 289f4ceb-0681-48c9-80b0-13bca56be78a ((None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}])) to volume 2e87d61e-c996-4193-9e7a-03403e2d44f7 successfully. {{(pid=84334) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Temporary image 289f4ceb-0681-48c9-80b0-13bca56be78a for user 8c660d3d633442aeb2fc9c1d2ff14db8 is deleted. {{(pid=84334) fetch /opt/stack/cinder/cinder/image/image_utils.py:1406}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.volume_utils [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Marking volume 2e87d61e-c996-4193-9e7a-03403e2d44f7 as bootable. {{(pid=84334) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.476s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-68e01a33-b833-42dc-98a9-c179403cbfd1-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Copying metadata from image 289f4ceb-0681-48c9-80b0-13bca56be78a to 2e87d61e-c996-4193-9e7a-03403e2d44f7. {{(pid=84334) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Creating volume glance metadata for volume 2e87d61e-c996-4193-9e7a-03403e2d44f7 backed by image 289f4ceb-0681-48c9-80b0-13bca56be78a with: {'image_id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '79e1ca258045def5659e3498b23100fa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84334) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:48:23 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Deleted volume successfully. Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-8062b00d-4d47-4097-9ac6-c7dffd2ab88f tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-2cb1b17e-6c8c-42a3-98de-7dce74bca407-delete_volume" released by "delete_volume" :: held 5.313s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:23 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "cinder-quobyte-68e01a33-b833-42dc-98a9-c179403cbfd1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-68e01a33-b833-42dc-98a9-c179403cbfd1" acquired by "delete_volume" :: waited 0.025s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[d578c491-f7bc-4f0d-b859-5b30ca2dfaed]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09891484-3b8b-46e1-a94b-790fb494d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e87d61e-c996-4193-9e7a-03403e2d44f7', 'volume_size': 1, 'image_id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289f4ceb-0681-48c9-80b0-13bca56be78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79e1ca258045def5659e3498b23100fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b4945348b1d4c47a2ea4314752808a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08f306cdaccf57459fc2795ea974d1d05b31b3354f789513b61bb3d3efb2e82b2a792b140b0d59e3f1af45e4458ae1f50619e0168d6ba2613a60c422c9cbfdca', 'id': '289f4ceb-0681-48c9-80b0-13bca56be78a', 'created_at': datetime.datetime(2025, 9, 25, 19, 47, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 19, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289f4ceb-0681-48c9-80b0-13bca56be78a/file', 'properties': {}}, 'image_service': }' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae986ba-adfb-407d-9fe0-9ae99e0c803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.733s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:24 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Volume volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 (2e87d61e-c996-4193-9e7a-03403e2d44f7): created successfully Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae986ba-adfb-407d-9fe0-9ae99e0c803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Flow 'volume_create_manager' (bd7db397-296d-4981-8d39-afcf6b811353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Deleted volume successfully. Sep 25 21:48:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4e60f082-1b9e-4145-a202-865891fa8e34 tempest-VolumeImageDependencyTests-1290512459 None] Created volume successfully. Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a4630c56-d586-4962-97ae-64fe4f3be896 tempest-CinderUnicodeTest-219949987 None] Lock "cinder-04d88577-27bb-43cc-9042-828844eaafe5-delete_volume" released by "delete_volume" :: held 4.825s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:24 devstack quobyte-client[84349]: System call of process 101711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1" returned: 0 in 0.726s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-68e01a33-b833-42dc-98a9-c179403cbfd1" returned: 0 in 0.111s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-quobyte-68e01a33-b833-42dc-98a9-c179403cbfd1" released by "delete_volume" :: held 1.307s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Created reservations ['71ffb9d4-647e-4e73-b481-0ccfa230279b', '773a8d06-4816-4386-b36b-3ba813d7538a', '75b1bc45-da1e-453b-af33-7bbc2ac6513b', '3f220b5b-ae5f-4979-aea2-0e3df163c102'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Acquiring lock "cinder-2e87d61e-c996-4193-9e7a-03403e2d44f7-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "cinder-2e87d61e-c996-4193-9e7a-03403e2d44f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:26 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Acquiring lock "cinder-quobyte-2e87d61e-c996-4193-9e7a-03403e2d44f7" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.448s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "cinder-quobyte-2e87d61e-c996-4193-9e7a-03403e2d44f7" acquired by "delete_volume" :: waited 0.077s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e38f10c-c95a-43cf-92ac-77d4ccba0549]: (4, 'raw') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:26 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Deleted volume successfully. Sep 25 21:48:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5d8203e5-8d1f-4af6-b3e3-b0dbfc139753 tempest-CreateVolumesFromImageTest-1177632860 None] Lock "cinder-68e01a33-b833-42dc-98a9-c179403cbfd1-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:27 devstack quobyte-client[84349]: System call of process 101717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 0 in 0.689s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 1 in 0.503s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7' failed. Not Retrying. {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2e87d61e-c996-4193-9e7a-03403e2d44f7" returned: 0 in 0.134s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "cinder-quobyte-2e87d61e-c996-4193-9e7a-03403e2d44f7" released by "delete_volume" :: held 1.675s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Created reservations ['23265b42-7112-4f0e-8ae3-bd4a512dab0f', 'dc549110-f213-4422-a3ea-947f01a2812e', '5f258bb7-3fce-4ff0-8a9d-8c009229bdff', '29771ba5-0651-43c6-8db3-237e32f80a4e'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.196s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:28 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:29 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Deleted volume successfully. Sep 25 21:48:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-95a12008-d844-4b74-a977-e216be72f34e tempest-VolumeImageDependencyTests-1290512459 None] Lock "cinder-2e87d61e-c996-4193-9e7a-03403e2d44f7-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:31 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (8a428d61-97e0-4475-97d5-f7fd5806eb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:31 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ccabc6-6cb2-4d42-82a8-e1f985f3a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ccabc6-6cb2-4d42-82a8-e1f985f3a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846122050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3db5c8-3ee2-4db5-b22f-5af9fade1dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:32Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ec7d52-cf95-4391-a5d7-0fa5ac2f5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ec7d52-cf95-4391-a5d7-0fa5ac2f5410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2048b79-c7da-40d6-b33f-6e6cc0ac10cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2048b79-c7da-40d6-b33f-6e6cc0ac10cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3db5c8-3ee2-4db5-b22f-5af9fade1dee', 'volume_name': 'volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d69aca-e5c3-4d43-9ba9-2f1ed7b55c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d69aca-e5c3-4d43-9ba9-2f1ed7b55c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dd886f-d53a-42ba-a04e-ee9bd6b0db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:32 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume ab3db5c8-3ee2-4db5-b22f-5af9fade1dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee', 'volume_size': 1} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846122050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3db5c8-3ee2-4db5-b22f-5af9fade1dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:32Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:32 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:32 devstack quobyte-client[84349]: System call of process 101757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:32 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=156, name=volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee 1073741824" returned: 0 in 0.502s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" returned: 0 in 0.190s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (851ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dd886f-d53a-42ba-a04e-ee9bd6b0db47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7b63bf-dc2e-4179-9671-8c05bf9b84d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:33 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee (ab3db5c8-3ee2-4db5-b22f-5af9fade1dee): created successfully Sep 25 21:48:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7b63bf-dc2e-4179-9671-8c05bf9b84d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:33 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (8a428d61-97e0-4475-97d5-f7fd5806eb97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:33 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a1b55eb8-d77d-4a0d-a50b-82dfe3914d1c tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:34 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating offline snapshot 65a2995c-032c-4d30-9d0a-729e6edf9882 of volume ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a3a96-fbe1-4ded-9bb8-062c8edafb9e]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:34 devstack quobyte-client[84349]: System call of process 101763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" returned: 0 in 0.489s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:34 devstack quobyte-client[84349]: System call of process 101767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:34 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=157, name=volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 1G" returned: 0 in 0.291s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:35 devstack quobyte-client[84349]: System call of process 101770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:35 devstack quobyte-client[84349]: System call of process 101770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:35 devstack quobyte-client[84349]: System call of process 101770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img rebase -u -b volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.176s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.111s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.info" returned: 0 in 0.101s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.info" returned: 0 in 0.100s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.748s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:36 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-74e8a33f-56d1-48c4-a8c6-cb364bfd8c80 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Create snapshot completed successfully Sep 25 21:48:37 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:37 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (cda06d63-7bcb-42c5-a6e3-500fde1779e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:37 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f144c61b-007a-4929-939c-0f4ce2b285de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f144c61b-007a-4929-939c-0f4ce2b285de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32322266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c574f-5da3-4f8e-8060-5433e8fe6bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:38Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deff03b-ba92-49e7-97af-c6f35a4aed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deff03b-ba92-49e7-97af-c6f35a4aed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a7e26a-7c8d-46df-b62b-22132505c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a7e26a-7c8d-46df-b62b-22132505c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21c574f-5da3-4f8e-8060-5433e8fe6bda', 'volume_name': 'volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ebdfad-ba81-4102-8ba4-550984026aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ebdfad-ba81-4102-8ba4-550984026aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be1cf66-39b3-4936-ad16-3b552681f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:38 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume a21c574f-5da3-4f8e-8060-5433e8fe6bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda', 'volume_size': 1} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32322266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c574f-5da3-4f8e-8060-5433e8fe6bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:38Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume a21c574f-5da3-4f8e-8060-5433e8fe6bda {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:38 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:38 devstack quobyte-client[84349]: System call of process 101777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:38 devstack quobyte-client[84349]: System call of process 101777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:38 devstack quobyte-client[84349]: System call of process 101777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:38 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=159, name=volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:38 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:38 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (53fd5bb8-7f3b-42c9-a843-cef1fbbf50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bae35f-db42-4cba-a276-878291da5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda 1073741824" returned: 0 in 0.950s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:39 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (d16e1d93-9dbe-42ed-8632-7b3ef6eb772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:39 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f5d6f-76e0-469d-a40e-f43a82310f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f5d6f-76e0-469d-a40e-f43a82310f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185589742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:39Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2b9c7a-2655-4be2-b5d3-b16d8705a1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2b9c7a-2655-4be2-b5d3-b16d8705a1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421a0313-47a1-4193-a551-cd6be0b543a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421a0313-47a1-4193-a551-cd6be0b543a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38', 'volume_name': 'volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08716589-f26f-45ef-baa7-e5dacd6256ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08716589-f26f-45ef-baa7-e5dacd6256ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf2f37f-b6d8-46c6-8e18-f164306adbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume 1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38', 'volume_size': 1} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bae35f-db42-4cba-a276-878291da5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-755148557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b5dab5-8e6b-4f64-9426-6aa4955c5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:38Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae1fdae-cfa2-445a-9e12-1be2b6366177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae1fdae-cfa2-445a-9e12-1be2b6366177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d95a4e-0da2-4746-b89f-2707a9277f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d95a4e-0da2-4746-b89f-2707a9277f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b5dab5-8e6b-4f64-9426-6aa4955c5e49', 'volume_name': 'volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deff2ca2-8eb3-4ffa-98b1-d96b9e15e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deff2ca2-8eb3-4ffa-98b1-d96b9e15e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaae6d89-5d67-4a55-bbe1-acd881863ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume 30b5dab5-8e6b-4f64-9426-6aa4955c5e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49', 'volume_size': 1} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda" returned: 0 in 1.038s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (2064ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185589742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:39Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume 1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:40 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:40 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=160, name=volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:40 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (8ded5c39-02fe-4658-87f3-5b6801d51acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a676e2-99f0-450d-9534-f9e4f8f232ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a676e2-99f0-450d-9534-f9e4f8f232ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640298682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f299a52-d614-435c-91bb-30ad28216f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:39Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a31193-5e09-42d9-b97a-702d5924c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a31193-5e09-42d9-b97a-702d5924c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d610e3-1857-4e92-a39c-5623c5af7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d610e3-1857-4e92-a39c-5623c5af7b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f299a52-d614-435c-91bb-30ad28216f17', 'volume_name': 'volume-3f299a52-d614-435c-91bb-30ad28216f17', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ff4c0-9e36-4bde-9e4b-43748d3f760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ff4c0-9e36-4bde-9e4b-43748d3f760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bebf6c-ccca-4adc-9cca-b4153961810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume 3f299a52-d614-435c-91bb-30ad28216f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f299a52-d614-435c-91bb-30ad28216f17', 'volume_size': 1} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be1cf66-39b3-4936-ad16-3b552681f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37354412-3cc7-40e5-8445-23045050274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (95198ea2-91fd-48a1-be9c-4e26bfcfb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace09b19-d745-49e5-b7bb-d31da1b1b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace09b19-d745-49e5-b7bb-d31da1b1b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720179960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1e184-1299-47d8-8347-68657f125e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:40Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f9298f-4d03-40b5-b0db-d7bef3a3cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f9298f-4d03-40b5-b0db-d7bef3a3cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9793692f-3940-4b02-b3e2-68802d5153b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9793692f-3940-4b02-b3e2-68802d5153b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d1e184-1299-47d8-8347-68657f125e78', 'volume_name': 'volume-36d1e184-1299-47d8-8347-68657f125e78', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0981c2-ce83-4701-8c13-fa513d7eee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0981c2-ce83-4701-8c13-fa513d7eee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee88fe5-08fa-44bf-a506-5e644de0b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume 36d1e184-1299-47d8-8347-68657f125e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d1e184-1299-47d8-8347-68657f125e78', 'volume_size': 1} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:41 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda (a21c574f-5da3-4f8e-8060-5433e8fe6bda): created successfully Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37354412-3cc7-40e5-8445-23045050274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (cda06d63-7bcb-42c5-a6e3-500fde1779e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.647s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 1073741824" returned: 0 in 1.273s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:41 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5375fd22-94aa-41c1-972e-7886dedc7f18 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" returned: 0 in 0.326s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (1676ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-755148557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b5dab5-8e6b-4f64-9426-6aa4955c5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:38Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume 30b5dab5-8e6b-4f64-9426-6aa4955c5e49 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:41 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:41 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:42 devstack quobyte-client[84349]: System call of process 101787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:42 devstack quobyte-client[84349]: System call of process 101787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:42 devstack quobyte-client[84349]: System call of process 101787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:42 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=161, name=volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf2f37f-b6d8-46c6-8e18-f164306adbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95913dc3-1762-4a05-b76d-28b81baf777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 1073741824" returned: 0 in 0.633s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:42 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 (1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38): created successfully Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95913dc3-1762-4a05-b76d-28b81baf777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:42 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (d16e1d93-9dbe-42ed-8632-7b3ef6eb772b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" returned: 0 in 0.431s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (1098ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.936s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640298682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f299a52-d614-435c-91bb-30ad28216f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:39Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume 3f299a52-d614-435c-91bb-30ad28216f17 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:43 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:43 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-151a605d-1e8f-41dd-919b-5a9dc452d3fa tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:43 devstack quobyte-client[84349]: System call of process 101797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:43 devstack quobyte-client[84349]: System call of process 101797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:43 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=162, name=volume-3f299a52-d614-435c-91bb-30ad28216f17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaae6d89-5d67-4a55-bbe1-acd881863ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043dc00e-3fed-4114-b471-fb722c794379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:43 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 (30b5dab5-8e6b-4f64-9426-6aa4955c5e49): created successfully Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043dc00e-3fed-4114-b471-fb722c794379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (53fd5bb8-7f3b-42c9-a843-cef1fbbf50ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17 1073741824" returned: 0 in 0.519s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:43 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-56be4747-bce8-4df5-af70-f2e8162ea698 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17" returned: 0 in 0.279s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (839ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720179960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1e184-1299-47d8-8347-68657f125e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0072d3815ac74bfe957292f9ac706875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:48:40Z,use_quota=True,user_id='d6ecd317180e49449cdd64ab84a6ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Creating volume 36d1e184-1299-47d8-8347-68657f125e78 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:43 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:48:43 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:44 devstack quobyte-client[84349]: System call of process 101801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:44 devstack quobyte-client[84349]: System call of process 101801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:44 devstack quobyte-client[84349]: System call of process 101801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:44 devstack quobyte-client[84349]: System call of process 101801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bebf6c-ccca-4adc-9cca-b4153961810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f299a52-d614-435c-91bb-30ad28216f17', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c159906-bfa8-4e07-a17b-0d391803f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:44 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=163, name=volume-36d1e184-1299-47d8-8347-68657f125e78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:48:44 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-3f299a52-d614-435c-91bb-30ad28216f17 (3f299a52-d614-435c-91bb-30ad28216f17): created successfully Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c159906-bfa8-4e07-a17b-0d391803f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (8ded5c39-02fe-4658-87f3-5b6801d51acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:44 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-33eec354-653b-4fcc-b88b-de1a58e6c106 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78 1073741824" returned: 0 in 0.624s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78" returned: 0 in 0.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] <== create_volume: return (808ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:48:44 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee88fe5-08fa-44bf-a506-5e644de0b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d1e184-1299-47d8-8347-68657f125e78', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89ea272-9888-4cfc-8799-9d2038396e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:48:45 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume volume-36d1e184-1299-47d8-8347-68657f125e78 (36d1e184-1299-47d8-8347-68657f125e78): created successfully Sep 25 21:48:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89ea272-9888-4cfc-8799-9d2038396e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:48:45 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Flow 'volume_create_manager' (95198ea2-91fd-48a1-be9c-4e26bfcfb04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:48:45 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-8507f16e-1289-4ec9-919f-83c0d81a9078 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created volume successfully. Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-36d1e184-1299-47d8-8347-68657f125e78-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-36d1e184-1299-47d8-8347-68657f125e78-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:46 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-36d1e184-1299-47d8-8347-68657f125e78" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-36d1e184-1299-47d8-8347-68657f125e78" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3634e-a496-4304-b6a4-1968e1f9b4ed]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:46 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78" returned: 0 in 0.494s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-36d1e184-1299-47d8-8347-68657f125e78" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-36d1e184-1299-47d8-8347-68657f125e78" released by "delete_volume" :: held 0.791s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['1468d6d7-aa71-428c-b67a-cb11ada32a1a', '718906f8-10b3-4585-ab12-1076769e1eab', 'e54aabed-3693-4bad-912d-071890852b8c', 'b5061913-ec66-4619-9014-37245f242198'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.099s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:47 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:48 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-85ea8393-e220-4d21-a923-6a0b16e94b0b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-36d1e184-1299-47d8-8347-68657f125e78-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-3f299a52-d614-435c-91bb-30ad28216f17-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-3f299a52-d614-435c-91bb-30ad28216f17-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=71,cinder:UPDATE=113,cinder:DELETE=10,cinder:INSERT=27 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:UPDATE=106,cinder:SELECT=74,cinder:DELETE=15,cinder:INSERT=22 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:48:48 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-3f299a52-d614-435c-91bb-30ad28216f17" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-3f299a52-d614-435c-91bb-30ad28216f17" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc2bbe-43e2-4760-b3ca-21b2852bba0f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:48 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:49 devstack quobyte-client[84349]: System call of process 101812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17" returned: 0 in 0.495s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:49 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-3f299a52-d614-435c-91bb-30ad28216f17" returned: 0 in 0.154s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:49 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-3f299a52-d614-435c-91bb-30ad28216f17" released by "delete_volume" :: held 0.824s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:49 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['1d7999a6-3717-40b0-9514-4134be20b164', '352387ba-d47b-42de-817f-de8065f7cc2f', '77eb8867-6f7f-49f4-83a4-423087a68bbf', '54e523e7-7b7e-4c88-a1d8-3412a9848651'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.094s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:50 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9584249b-ca25-44c1-a0a2-d37d94f09480 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-3f299a52-d614-435c-91bb-30ad28216f17-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:50 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:51 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" acquired by "delete_volume" :: waited 0.008s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d297d-fcec-4aa6-b521-c6d76d0208c1]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" returned: 0 in 0.546s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:51 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" returned: 0 in 0.172s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38" released by "delete_volume" :: held 0.955s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['122c33dc-7ba3-4917-aa13-de3279558a6c', '42e8dc43-7950-47b5-ae97-c871b264984f', '9878839f-c959-4058-81fe-361fdb8c9442', 'ecbf6cea-0d6c-4ae5-a006-3ce2bcb2c603'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:52 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.188s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:53 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-30b5dab5-8e6b-4f64-9426-6aa4955c5e49-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cd53afd6-4f9a-49ca-8b27-fc7878723edb tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-1aac911c-73a4-4ee6-a9c2-c2c8afb9aa38-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-30b5dab5-8e6b-4f64-9426-6aa4955c5e49-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:53 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af2de19-52b0-422c-b143-25d6369eca7f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:53 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" returned: 0 in 0.470s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:54 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" returned: 0 in 0.169s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:54 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-30b5dab5-8e6b-4f64-9426-6aa4955c5e49" released by "delete_volume" :: held 0.846s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['29b9f08e-a74d-42eb-8a5e-cff005cb4aac', 'e343890b-8b69-4eef-9c8b-087a00d745e9', '439f9d69-0125-483c-8f4f-30edee9df26c', '4c4ef6cc-c11b-4cf4-a644-7ce50c27d689'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.116s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:55 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:48:55 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9d994253-9cd7-48cb-9c53-2d0610eafe8b tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-30b5dab5-8e6b-4f64-9426-6aa4955c5e49-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-a21c574f-5da3-4f8e-8060-5433e8fe6bda-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-a21c574f-5da3-4f8e-8060-5433e8fe6bda-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:56 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-a21c574f-5da3-4f8e-8060-5433e8fe6bda" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-a21c574f-5da3-4f8e-8060-5433e8fe6bda" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7f70ea-84d6-4d1c-a2da-5c1371a33b0b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda" returned: 0 in 0.498s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:56 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-a21c574f-5da3-4f8e-8060-5433e8fe6bda" returned: 0 in 0.104s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-a21c574f-5da3-4f8e-8060-5433e8fe6bda" released by "delete_volume" :: held 0.776s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['9556c4a2-c862-4de3-81bf-832c323daaeb', '8c23b6b7-6209-46a5-a376-92b171f988ff', '059ee4b3-6b4e-48d7-bd32-742ae62367c5', 'bd99c7cd-9f9d-4f42-a338-bc0d3ca025aa'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.130s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:48:57 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:48:57 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-24d892d2-8253-4c74-9cdb-56272eb6e772 tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-a21c574f-5da3-4f8e-8060-5433e8fe6bda-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-65a2995c-032c-4d30-9d0a-729e6edf9882-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-65a2995c-032c-4d30-9d0a-729e6edf9882-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:58 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-65a2995c-032c-4d30-9d0a-729e6edf9882" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-65a2995c-032c-4d30-9d0a-729e6edf9882" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleting offline snapshot 65a2995c-032c-4d30-9d0a-729e6edf9882 of volume ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] snapshot_file for this snap is: volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[94322d2d-abd0-4e12-9dac-302596710179]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:58 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:59 devstack quobyte-client[84349]: System call of process 101833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.486s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd2e170-02c7-45b5-bb5f-0b3d33aca623]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" returned: 0 in 0.495s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:48:59 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:48:59 devstack quobyte-client[84349]: System call of process 101839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.273s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee.65a2995c-032c-4d30-9d0a-729e6edf9882" returned: 0 in 0.177s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-65a2995c-032c-4d30-9d0a-729e6edf9882" released by "_delete_snapshot" :: held 1.800s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" released by "delete_snapshot" :: held 1.838s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['8c08658e-42b4-48fa-953b-404fdc081fae', '4bf08c6a-bb0f-4679-9f83-5b99f20761fd', '475d0c64-f3f0-4b7f-b76f-b6ee7efef1a2', '980e0b7a-56dd-4ef6-9189-f5ec20c2670f'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:00 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Delete snapshot completed successfully. Sep 25 21:49:00 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-73d9ee1e-65bb-4b9a-8c3e-440ce53be03f tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-65a2995c-032c-4d30-9d0a-729e6edf9882-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:01 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Flow 'volume_create_manager' (d1dbe332-dc3d-48d5-aee6-b13289086fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a018a6-02c3-4df0-a855-dffed9801629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a018a6-02c3-4df0-a855-dffed9801629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1950643216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da5cf95-d3fb-4595-881c-35e8b16a15ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a9bf3a150147569fa24757546dc11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:01Z,use_quota=True,user_id='d86f56a5569b4654b080be29d78bbfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabf1640-644f-45db-86b2-f42327b24dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabf1640-644f-45db-86b2-f42327b24dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f6a289-d3c9-441c-9704-1940908ad80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f6a289-d3c9-441c-9704-1940908ad80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da5cf95-d3fb-4595-881c-35e8b16a15ca', 'volume_name': 'volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0578c8c5-1498-4f24-be88-9002e95d9698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0578c8c5-1498-4f24-be88-9002e95d9698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a430ac53-7041-4fdd-9307-32be99eaf66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:01 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Volume 4da5cf95-d3fb-4595-881c-35e8b16a15ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca', 'volume_size': 1} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1950643216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da5cf95-d3fb-4595-881c-35e8b16a15ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a9bf3a150147569fa24757546dc11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:01Z,use_quota=True,user_id='d86f56a5569b4654b080be29d78bbfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Creating volume 4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:01 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:01 devstack quobyte-client[84349]: System call of process 101843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:01 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=164, name=volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:01 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca 1073741824" returned: 0 in 0.527s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.315s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] <== create_volume: return (882ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:02 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a430ac53-7041-4fdd-9307-32be99eaf66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2820790d-62d4-497b-8673-19e3b9e35b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" acquired by "delete_volume" :: waited 0.102s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:02 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Volume volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca (4da5cf95-d3fb-4595-881c-35e8b16a15ca): created successfully Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2820790d-62d4-497b-8673-19e3b9e35b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Flow 'volume_create_manager' (d1dbe332-dc3d-48d5-aee6-b13289086fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e27505-c63a-4940-9991-5657d603a974]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:02 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:02 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-28ee6c46-672b-4a34-b3a9-239da2df9dcc tempest-SnapshotDependencyTests-2001186826 None] Created volume successfully. Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" returned: 0 in 0.528s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" returned: 0 in 0.090s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-quobyte-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee" released by "delete_volume" :: held 0.842s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Created reservations ['4e866567-c78c-46de-a570-1e3f8396e3b7', '194396d6-aa7a-44c0-82c1-f99eb48feb4e', 'da7fe25c-ba03-46bd-845b-b14c70d721b1', '528f74bd-0593-43ff-abbe-6ff0cfdbd78c'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:03 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.367s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:04 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:04 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Deleted volume successfully. Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Creating offline snapshot 4995e515-15b0-4cca-90d0-2253000a50d1 of volume 4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18daed-c189-4bdb-a285-61d8057ab568]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-add24081-a1dd-4604-b0d5-a067d0c3385a tempest-CreateVolumesFromSnapshotTest-1278593991 None] Lock "cinder-ab3db5c8-3ee2-4db5-b22f-5af9fade1dee-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:04 devstack quobyte-client[84349]: System call of process 101852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:04 devstack quobyte-client[84349]: System call of process 101852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.515s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:04 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 1G {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:05 devstack quobyte-client[84349]: System call of process 101856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:05 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=165, name=volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 1G" returned: 0 in 0.256s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:05 devstack quobyte-client[84349]: System call of process 101859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "qemu-img rebase -u -b volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca -F qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.172s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.103s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Setting permissions: /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca -> 1000:1000 {{(pid=84334) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.117s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.info" returned: 0 in 0.115s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.info is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:49:05 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.info {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.info" returned: 0 in 0.121s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:06 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:06 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-dbd07894-0b36-4e85-bd2c-e9fa3689ec84 tempest-SnapshotDependencyTests-2001186826 None] Create snapshot completed successfully Sep 25 21:49:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (1b000fa2-0cd0-476a-93fe-695fb55d34d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4794aa9-4e4d-46df-ae51-95915355fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4794aa9-4e4d-46df-ae51-95915355fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926474479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed830dea-f4fa-4258-9270-d6e0a722a3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:07Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05451d-2f40-4b8f-8406-3f0a38531efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05451d-2f40-4b8f-8406-3f0a38531efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b80b5-ee68-4819-a224-a3326fefe222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b80b5-ee68-4819-a224-a3326fefe222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed830dea-f4fa-4258-9270-d6e0a722a3f9', 'volume_name': 'volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2606e8aa-a52f-443d-a811-2693dcc710ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2606e8aa-a52f-443d-a811-2693dcc710ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0ce2ef-6096-4ba9-bf56-67f63ea52553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:07 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume ed830dea-f4fa-4258-9270-d6e0a722a3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9', 'volume_size': 1} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926474479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed830dea-f4fa-4258-9270-d6e0a722a3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:07Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume ed830dea-f4fa-4258-9270-d6e0a722a3f9 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:07 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:07 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:07 devstack quobyte-client[84349]: System call of process 101866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:07 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=167, name=volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:07 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 1073741824" returned: 0 in 0.417s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9" returned: 0 in 0.165s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Flow 'volume_create_manager' (560ca86b-7925-47e9-9937-b66d81b1860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a198ab74-f221-45c7-bfbf-96bc22240122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0ce2ef-6096-4ba9-bf56-67f63ea52553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e3c58b-8f07-42c6-bfe6-93e907e14ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a198ab74-f221-45c7-bfbf-96bc22240122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80527a13-87a6-4577-be14-eeb519b7d008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a9bf3a150147569fa24757546dc11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4995e515-15b0-4cca-90d0-2253000a50d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:08Z,use_quota=True,user_id='d86f56a5569b4654b080be29d78bbfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03b349d-6596-479b-a1c7-c0c9045a2ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03b349d-6596-479b-a1c7-c0c9045a2ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359db35-687f-442f-b808-10fa8da42258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359db35-687f-442f-b808-10fa8da42258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80527a13-87a6-4577-be14-eeb519b7d008', 'volume_name': 'volume-80527a13-87a6-4577-be14-eeb519b7d008', 'volume_size': 1, 'snapshot_id': '4995e515-15b0-4cca-90d0-2253000a50d1'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fb1b74-72ab-4979-9a76-3b4f0b224c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fb1b74-72ab-4979-9a76-3b4f0b224c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140de0b3-97c5-407a-a9c7-478861d01428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Volume 80527a13-87a6-4577-be14-eeb519b7d008: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80527a13-87a6-4577-be14-eeb519b7d008', 'volume_size': 1, 'snapshot_id': '4995e515-15b0-4cca-90d0-2253000a50d1'} Sep 25 21:49:08 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 (ed830dea-f4fa-4258-9270-d6e0a722a3f9): created successfully Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e3c58b-8f07-42c6-bfe6-93e907e14ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (1b000fa2-0cd0-476a-93fe-695fb55d34d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1-80527a13-87a6-4577-be14-eeb519b7d008" by "_create_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:08 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cdc78b03-b0a4-4334-a6fb-efd5a7c465ba tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1-80527a13-87a6-4577-be14-eeb519b7d008" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Creating volume 80527a13-87a6-4577-be14-eeb519b7d008 from snapshot 4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" by "_copy_volume_from_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] snapshot: 4995e515-15b0-4cca-90d0-2253000a50d1, volume: 80527a13-87a6-4577-be14-eeb519b7d008, {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:08 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7b868-d21b-4e5e-94ea-f244bf5f42ae]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.353s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Creating direct copy from snapshot {{(pid=84334) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967f994-f7d1-4824-845e-ce7ec446202f]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.413s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG cinder.utils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 not found in is_blk_device check {{(pid=84334) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 25 21:49:09 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:10 devstack quobyte-client[84349]: System call of process 101876 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:10 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=168, name=volume-80527a13-87a6-4577-be14-eeb519b7d008, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:10 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:10 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (01e9078a-fdad-4f4d-a8be-ba6e8f8d0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:11 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d97a4e4-18e6-4460-929e-95f72f19aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d97a4e4-18e6-4460-929e-95f72f19aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1026382935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32091dd7-d53f-40d3-8dfd-ea74e78fffdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:10Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f9751-bc40-43a6-b322-5c5729568b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f9751-bc40-43a6-b322-5c5729568b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c381d8fc-e7b5-4aa2-a591-3f211a5add34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c381d8fc-e7b5-4aa2-a591-3f211a5add34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32091dd7-d53f-40d3-8dfd-ea74e78fffdd', 'volume_name': 'volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8342e6f-0a3d-4dc1-8427-138fa05b3be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8342e6f-0a3d-4dc1-8427-138fa05b3be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbbb0a1-7558-4ee7-847a-2142c3d0dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:12 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume 32091dd7-d53f-40d3-8dfd-ea74e78fffdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd', 'volume_size': 1} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:12 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (ee659c90-e430-40be-80d3-7ea09e9556c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:12 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3afeaa-b158-4ec7-8e18-96dc921a8216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (2a6de2c0-8f7b-4618-8520-06036eb9c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2eb6f4f-5b7b-4c81-9fb2-b6fa0ef7d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3afeaa-b158-4ec7-8e18-96dc921a8216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1882982368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:12Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c89ca9-8575-4a09-bcb3-fa847fb9fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c89ca9-8575-4a09-bcb3-fa847fb9fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e18654c-6707-4163-8786-9addd6edfc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e18654c-6707-4163-8786-9addd6edfc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3', 'volume_name': 'volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa665219-9231-48c5-ab02-6053d4f89590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa665219-9231-48c5-ab02-6053d4f89590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda19406-c942-4e69-a530-7bcf03f6e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume 0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3', 'volume_size': 1} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2eb6f4f-5b7b-4c81-9fb2-b6fa0ef7d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972735839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e919cccb-8126-4c65-a02d-0072f5d782e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:11Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498b3d3a-101d-44d5-9b4f-1e20b466b1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498b3d3a-101d-44d5-9b4f-1e20b466b1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b97911-d9ca-4d9d-bd3f-8e005d0a27f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b97911-d9ca-4d9d-bd3f-8e005d0a27f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e919cccb-8126-4c65-a02d-0072f5d782e1', 'volume_name': 'volume-e919cccb-8126-4c65-a02d-0072f5d782e1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b6dd7e-2a52-4105-b10c-75a799eae411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b6dd7e-2a52-4105-b10c-75a799eae411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324cfbc6-9ba6-4a48-bad0-acdb8b782329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume e919cccb-8126-4c65-a02d-0072f5d782e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e919cccb-8126-4c65-a02d-0072f5d782e1', 'volume_size': 1} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:13 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (401bcac1-1654-4078-8f39-3b6d19aa5318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61c945d-98fe-4762-868f-edfd36094fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61c945d-98fe-4762-868f-edfd36094fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752003452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b23125-6dc5-4d7a-8076-0168a6910e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:13Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc4b424-1bcf-45c4-906e-b130bbfebf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc4b424-1bcf-45c4-906e-b130bbfebf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:13 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e4f496-7af5-4125-bf38-ea0c6bb11a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e4f496-7af5-4125-bf38-ea0c6bb11a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b23125-6dc5-4d7a-8076-0168a6910e66', 'volume_name': 'volume-17b23125-6dc5-4d7a-8076-0168a6910e66', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c92f929-45fa-445d-bb0b-2e9a16534709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c92f929-45fa-445d-bb0b-2e9a16534709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7353202-79ce-4571-9b66-0f237797f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:14 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume 17b23125-6dc5-4d7a-8076-0168a6910e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b23125-6dc5-4d7a-8076-0168a6910e66', 'volume_size': 1} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:14 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84334) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (09fd9076-8419-429c-97c3-c18ecde5e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:14 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ae00ad-ac1f-41f2-bede-f088493b2529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ae00ad-ac1f-41f2-bede-f088493b2529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887486287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2517b057-eb57-4118-aa01-f49844fb542d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:15Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f2082c-2f9c-4fef-af97-2d59b0479579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f2082c-2f9c-4fef-af97-2d59b0479579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a3b5d-1f7f-49a5-a1b7-55155bf1a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a3b5d-1f7f-49a5-a1b7-55155bf1a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2517b057-eb57-4118-aa01-f49844fb542d', 'volume_name': 'volume-2517b057-eb57-4118-aa01-f49844fb542d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e89ddb-a688-4f9a-be3a-4cf985aa3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e89ddb-a688-4f9a-be3a-4cf985aa3d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b39624-ea6e-45ff-a85c-c7e861a6e9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:15 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume 2517b057-eb57-4118-aa01-f49844fb542d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2517b057-eb57-4118-aa01-f49844fb542d', 'volume_size': 1} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008" returned: 0 in 5.443s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333ef87-ff7d-4f2f-b1f4-326b91648aef]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.543s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.image.image_utils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Image conversion details: src /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 {{(pid=84334) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:502}} Sep 25 21:49:15 devstack cinder-volume[84334]: INFO cinder.image.image_utils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Converted 1024.00 MB image at 187.98 MB/s Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] File path /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 is being set with permissions: 660 {{(pid=84334) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 25 21:49:15 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008" returned: 0 in 0.087s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" released by "_copy_volume_from_snapshot" :: held 7.237s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1-80527a13-87a6-4577-be14-eeb519b7d008" released by "_create_volume_from_snapshot" :: held 7.275s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.300s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.735s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1026382935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32091dd7-d53f-40d3-8dfd-ea74e78fffdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:10Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume 32091dd7-d53f-40d3-8dfd-ea74e78fffdd {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:16 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:16 devstack quobyte-client[84349]: System call of process 101891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:16 devstack quobyte-client[84349]: System call of process 101891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:16 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=169, name=volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140de0b3-97c5-407a-a9c7-478861d01428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80527a13-87a6-4577-be14-eeb519b7d008', 'volume_size': 1, 'snapshot_id': '4995e515-15b0-4cca-90d0-2253000a50d1'}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca755102-7383-471f-b292-29ded425c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd 1073741824" returned: 0 in 0.467s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:16 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:16 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Volume volume-80527a13-87a6-4577-be14-eeb519b7d008 (80527a13-87a6-4577-be14-eeb519b7d008): created successfully Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca755102-7383-471f-b292-29ded425c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Flow 'volume_create_manager' (560ca86b-7925-47e9-9937-b66d81b1860d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" returned: 0 in 0.400s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (898ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.726s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1882982368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:12Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume 0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:17 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-4995e515-15b0-4cca-90d0-2253000a50d1-delete_snapshot" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:17 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=170, name=volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:17 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-4b5aefc1-6932-4eac-b1a6-3ba0c79559a7 tempest-SnapshotDependencyTests-2001186826 None] Created volume successfully. Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbbb0a1-7558-4ee7-847a-2142c3d0dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007554f-a84c-463c-9e0d-affca6b6da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-4995e515-15b0-4cca-90d0-2253000a50d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.334s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:17 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" by "delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 1073741824" returned: 0 in 0.481s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:17 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd (32091dd7-d53f-40d3-8dfd-ea74e78fffdd): created successfully Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007554f-a84c-463c-9e0d-affca6b6da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:17 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (01e9078a-fdad-4f4d-a8be-ba6e8f8d0967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:18 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-7ac5ecde-ebf1-4134-a58b-2d073254884e tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" returned: 0 in 0.388s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" acquired by "delete_snapshot" :: waited 0.403s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1" by "_delete_snapshot" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (912ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972735839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e919cccb-8126-4c65-a02d-0072f5d782e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:11Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume e919cccb-8126-4c65-a02d-0072f5d782e1 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:18 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:18 devstack quobyte-client[84349]: System call of process 101899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:18 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=171, name=volume-e919cccb-8126-4c65-a02d-0072f5d782e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda19406-c942-4e69-a530-7bcf03f6e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c512da-082b-4654-a1ea-cb8d3fc37e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1" acquired by "_delete_snapshot" :: waited 0.464s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Deleting offline snapshot 4995e515-15b0-4cca-90d0-2253000a50d1 of volume 4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] snapshot_file for this snap is: volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 25 21:49:18 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 (0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3): created successfully Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c512da-082b-4654-a1ea-cb8d3fc37e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (ee659c90-e430-40be-80d3-7ea09e9556c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc885e3-3e68-4a78-9e1e-88b92f44046b]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1 1073741824" returned: 0 in 0.554s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:18 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:19 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-73295d35-1e58-4c81-8c18-73d9e4097ce9 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:19 devstack quobyte-client[84349]: System call of process 101902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:19 devstack quobyte-client[84349]: System call of process 101902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:19 devstack quobyte-client[84349]: System call of process 101902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:19 devstack quobyte-client[84349]: System call of process 101902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1" returned: 0 in 0.406s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (1093ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.317s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752003452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b23125-6dc5-4d7a-8076-0168a6910e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:13Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume 17b23125-6dc5-4d7a-8076-0168a6910e66 {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:19 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:19 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=172, name=volume-17b23125-6dc5-4d7a-8076-0168a6910e66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324cfbc6-9ba6-4a48-bad0-acdb8b782329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e919cccb-8126-4c65-a02d-0072f5d782e1', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218bb32-3289-46ae-8a69-f82b280b5725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 1.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84334) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d4deff-6bc9-43d8-82bc-6861ca0b2d06]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:19 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:20 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-e919cccb-8126-4c65-a02d-0072f5d782e1 (e919cccb-8126-4c65-a02d-0072f5d782e1): created successfully Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218bb32-3289-46ae-8a69-f82b280b5725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (2a6de2c0-8f7b-4618-8520-06036eb9c903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66 1073741824" returned: 0 in 0.857s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:20 devstack quobyte-client[84349]: System call of process 101909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:20 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-964094c9-3c46-4905-9d6f-f318a15b0b63 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66" returned: 0 in 0.336s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (1245ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.754s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.555s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-25T19:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887486287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2517b057-eb57-4118-aa01-f49844fb542d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807542c11bbe42cabe4af56bd88549a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T19:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T19:49:15Z,use_quota=True,user_id='880cf3c45b84418fb1b806c4226f7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a0accde-34b0-41e4-8234-5743cd5a7a13),volume_type_id=2a0accde-34b0-41e4-8234-5743cd5a7a13)}" {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1508}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.remotefs [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Creating volume 2517b057-eb57-4118-aa01-f49844fb542d {{(pid=84334) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Selected 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 as target Quobyte volume. {{(pid=84334) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 25 21:49:20 devstack cinder-volume[84334]: INFO cinder.volume.drivers.remotefs [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] casted to 10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002 Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d 1073741824 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:20 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:20 devstack quobyte-client[84349]: The server volume:e2c4ca12-45b4-4111-a93e-91d8f6f83660@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e2c4ca12-45b4-4111-a93e-91d8f6f83660, inode=173, name=volume-2517b057-eb57-4118-aa01-f49844fb542d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.83), requestorAccessMask=0 Sep 25 21:49:20 devstack quobyte-client[84349]: System call of process 101916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:20 devstack quobyte-client[84349]: System call of process 101916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:20 devstack quobyte-client[84349]: System call of process 101916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7353202-79ce-4571-9b66-0f237797f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b23125-6dc5-4d7a-8076-0168a6910e66', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33cf171-2a6b-4420-869f-76d732cd1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d 1073741824" returned: 0 in 0.527s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:21 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-17b23125-6dc5-4d7a-8076-0168a6910e66 (17b23125-6dc5-4d7a-8076-0168a6910e66): created successfully Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33cf171-2a6b-4420-869f-76d732cd1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (401bcac1-1654-4078-8f39-3b6d19aa5318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.773s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:21 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cad33e65-2578-4eba-8d80-0add74dae5ae tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d" returned: 0 in 0.604s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'} {{(pid=84334) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1533}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca.4995e515-15b0-4cca-90d0-2253000a50d1" returned: 0 in 0.285s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b39624-ea6e-45ff-a85c-c7e861a6e9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2517b057-eb57-4118-aa01-f49844fb542d', 'volume_size': 1}' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1e790b-9366-43e8-8153-27d0636415be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4995e515-15b0-4cca-90d0-2253000a50d1" released by "_delete_snapshot" :: held 3.340s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:21 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" released by "delete_snapshot" :: held 3.821s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:22 devstack cinder-volume[84334]: INFO cinder.volume.flows.manager.create_volume [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume volume-2517b057-eb57-4118-aa01-f49844fb542d (2517b057-eb57-4118-aa01-f49844fb542d): created successfully Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1e790b-9366-43e8-8153-27d0636415be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84334) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Flow 'volume_create_manager' (09fd9076-8419-429c-97c3-c18ecde5e030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84334) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 25 21:49:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-3da89e4b-9815-4b71-9fb9-b9c1cdd458a8 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created volume successfully. Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Created reservations ['9c7fd373-f9fd-4c46-9c2a-d326e9db8eaf', 'eea57360-fb9f-4035-9bd2-1ba55c0e28d2', '7deef303-e45c-4063-9d5f-fd825bef3ea8', 'b4775d71-9389-4292-af8b-6dcd755f81a2'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:22 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Delete snapshot completed successfully. Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-5b37019d-eecd-4470-a9f9-cff1de5d3500 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-4995e515-15b0-4cca-90d0-2253000a50d1-delete_snapshot" released by "delete_snapshot" :: held 4.555s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-4da5cf95-d3fb-4595-881c-35e8b16a15ca-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-4da5cf95-d3fb-4595-881c-35e8b16a15ca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-2517b057-eb57-4118-aa01-f49844fb542d-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-2517b057-eb57-4118-aa01-f49844fb542d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" acquired by "delete_volume" :: waited 0.015s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11684d6-f46e-4a83-b74b-a96f259df6ed]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:22 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:22 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-2517b057-eb57-4118-aa01-f49844fb542d" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-2517b057-eb57-4118-aa01-f49844fb542d" acquired by "delete_volume" :: waited 0.103s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd478c45-8cb6-454c-8ef3-65919289fbca]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:23 devstack quobyte-client[84349]: System call of process 101921 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.563s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-4da5cf95-d3fb-4595-881c-35e8b16a15ca" returned: 0 in 0.102s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:23 devstack quobyte-client[84349]: System call of process 101922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-4da5cf95-d3fb-4595-881c-35e8b16a15ca" released by "delete_volume" :: held 0.895s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d" returned: 0 in 0.693s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:23 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-2517b057-eb57-4118-aa01-f49844fb542d" returned: 0 in 0.311s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-2517b057-eb57-4118-aa01-f49844fb542d" released by "delete_volume" :: held 1.144s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Created reservations ['9cd4a86a-dc37-4ffd-87a1-4ea103fe1747', '73aacd5a-ac8e-4a78-ace9-5784c689e375', '99aa1080-1d55-44ac-b0d2-645e50200507', '20617a96-ae38-460d-b142-2993765e91a8'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['5367b3ee-c974-41dc-88bf-56d161c70f4a', '3b531342-71a9-4ac8-b94b-ee88e0932ea1', '146d3520-5721-46c5-a2aa-fccbfd71401b', '114eea7f-2f58-4a5b-a912-0540fd793a55'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.304s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:24 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Deleted volume successfully. Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-e33e03a6-0092-46f6-b828-c3b1e61e2ba7 tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-4da5cf95-d3fb-4595-881c-35e8b16a15ca-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:24 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-80527a13-87a6-4577-be14-eeb519b7d008-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-17b23125-6dc5-4d7a-8076-0168a6910e66-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.339s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:25 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-17b23125-6dc5-4d7a-8076-0168a6910e66-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-80527a13-87a6-4577-be14-eeb519b7d008-delete_volume" acquired by "delete_volume" :: waited 0.258s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-1a53e7f5-f394-44f0-bd87-822962f688d3 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-2517b057-eb57-4118-aa01-f49844fb542d-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:25 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-17b23125-6dc5-4d7a-8076-0168a6910e66" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" acquired by "delete_volume" :: waited 0.018s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-17b23125-6dc5-4d7a-8076-0168a6910e66" acquired by "delete_volume" :: waited 0.031s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7619bc-7000-4ce3-b078-f96cc43e18a2]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7a40e-4c39-4393-9ed8-294fe8ba8443]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:25 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:26 devstack quobyte-client[84349]: System call of process 101933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008" returned: 0 in 0.512s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-80527a13-87a6-4577-be14-eeb519b7d008" returned: 0 in 0.123s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66" returned: 0 in 0.643s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-quobyte-80527a13-87a6-4577-be14-eeb519b7d008" released by "delete_volume" :: held 0.837s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-17b23125-6dc5-4d7a-8076-0168a6910e66" returned: 0 in 0.273s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:26 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-17b23125-6dc5-4d7a-8076-0168a6910e66" released by "delete_volume" :: held 1.279s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Created reservations ['8a9c1030-b788-4063-8efc-7cd30c068f47', '9a2c1244-7be2-469a-90c5-3d83474f6500', '0bb47435-f10f-43a9-abce-1e9492253386', '28d6eee6-68e4-47b6-bd5d-6dbad03eca9f'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['c72b906f-56d2-45b0-8552-febfdb57e1e6', '73670be6-34d0-4766-95d2-3948757175f7', '44196216-814f-46a5-8c63-243803196ab9', '7c468d38-f7d8-4048-8499-e493269be6c0'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.678s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:27 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3-delete_volume" acquired by "delete_volume" :: waited 0.393s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:28 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Deleted volume successfully. Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.455s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:28 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-9f77e0b2-945b-4777-ab9e-7bebe77577fe tempest-SnapshotDependencyTests-2001186826 None] Lock "cinder-80527a13-87a6-4577-be14-eeb519b7d008-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:28 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0d9f3fbe-1021-413e-9218-57bf4be378e2 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-17b23125-6dc5-4d7a-8076-0168a6910e66-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" acquired by "delete_volume" :: waited 0.023s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f215fd-df4a-47cd-8615-e87970d81b43]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:28 devstack quobyte-client[84349]: System call of process 101943 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" returned: 0 in 0.533s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:28 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" returned: 0 in 0.109s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3" released by "delete_volume" :: held 0.891s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['ddaa07eb-1cda-4cc9-92d7-d3eeaeb6fbfd', 'b97e71a7-3c57-49e7-bf68-38a6186b6c47', '3b7faf2d-098d-44bd-a8f9-ddf39a0b0889', '05fd7ab0-e80c-4175-9952-d32d6527a4b3'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:29 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:30 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.302s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:30 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:30 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-e919cccb-8126-4c65-a02d-0072f5d782e1-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-0e88b176-eb0e-4dc4-967f-32c2dbe5d967 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-0fa0c9c6-3fcc-4de4-a3f8-5508403d3ea3-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-e919cccb-8126-4c65-a02d-0072f5d782e1-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:31 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-e919cccb-8126-4c65-a02d-0072f5d782e1" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-e919cccb-8126-4c65-a02d-0072f5d782e1" acquired by "delete_volume" :: waited 0.012s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d695fbe-302a-4d68-8791-7f37f4ce643d]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:31 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1" returned: 0 in 0.531s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:32 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-e919cccb-8126-4c65-a02d-0072f5d782e1" returned: 0 in 0.245s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:32 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-e919cccb-8126-4c65-a02d-0072f5d782e1" released by "delete_volume" :: held 1.077s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:32 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['1a8ca4f1-00f3-4765-95db-02944dc4c46e', '856c1fa6-87eb-4dcc-a48a-ae1d96bdb50a', 'b70cd73f-00d9-4b6f-b084-061db9505658', 'e4147869-7d92-49d0-8494-a61e5da3c6a7'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.136s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:33 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-32091dd7-d53f-40d3-8dfd-ea74e78fffdd-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-18ed335d-1cd4-4980-95f9-494eed0bc52f tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-e919cccb-8126-4c65-a02d-0072f5d782e1-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-32091dd7-d53f-40d3-8dfd-ea74e78fffdd-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:33 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:33 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" acquired by "delete_volume" :: waited 0.016s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f901df2-4a38-4742-8b91-5fe546d91f02]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" returned: 0 in 0.575s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" returned: 0 in 0.161s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:34 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-32091dd7-d53f-40d3-8dfd-ea74e78fffdd" released by "delete_volume" :: held 0.964s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['47f1b494-a822-4b62-b33c-603d475b2e8b', '1761fbf1-348e-4668-b1a2-cdb3a0847461', 'd649d706-8a49-4eff-a427-53206533a948', '045bad13-14de-4329-ad1b-4a17ac905e67'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.119s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:35 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:35 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-a3c0d550-5e98-4197-bcde-8c371255fad6 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-32091dd7-d53f-40d3-8dfd-ea74e78fffdd-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-ed830dea-f4fa-4258-9270-d6e0a722a3f9-delete_volume" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-ed830dea-f4fa-4258-9270-d6e0a722a3f9-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:36 devstack cinder-volume[84334]: WARNING cinder.volume.volume_utils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "cinder-quobyte-ed830dea-f4fa-4258-9270-d6e0a722a3f9" by "delete_volume" {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-ed830dea-f4fa-4258-9270-d6e0a722a3f9" acquired by "delete_volume" :: waited 0.011s {{(pid=84334) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e9247c-be0c-406d-9203-68191b8f69bd]: (4, 'qcow2') {{(pid=84682) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9" returned: 0 in 0.527s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:36 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "rm -f /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30/volume-ed830dea-f4fa-4258-9270-d6e0a722a3f9" returned: 0 in 0.173s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-quobyte-ed830dea-f4fa-4258-9270-d6e0a722a3f9" released by "delete_volume" :: held 1.038s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG cinder.quota [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Created reservations ['dd9b7e52-9295-43c9-85f6-9fda9865331d', '8b3d306b-4ea3-4fa4-a53a-4d2b07f97ffd', 'e743b272-f219-425b-b62a-fb1afc2ef393', '3a54e951-6825-487a-b31f-b98cc060c4f7'] {{(pid=84334) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:37 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:38 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.110s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:38 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:38 devstack cinder-volume[84334]: INFO cinder.volume.manager [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Deleted volume successfully. Sep 25 21:49:38 devstack cinder-volume[84334]: DEBUG cinder.coordination [None req-cfb0e420-154b-4da2-a7bf-5e580c5fddb7 tempest-CreateVolumesFromSourceVolumeTest-1249987079 None] Lock "cinder-ed830dea-f4fa-4258-9270-d6e0a722a3f9-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=84334) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_service.periodic_task [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002': None} {{(pid=84334) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG cinder.volume.drivers.quobyte [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Available shares ['10.10.41.181/cinder-vol-f590f695-71b5-403d-b04b-88616e755002'] {{(pid=84334) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.lockutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84334) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30 {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 25 21:49:40 devstack cinder-volume[84334]: DEBUG oslo_concurrency.processutils [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8459b6f6a76c1074d3f00237fc1e1d30" returned: 0 in 0.127s {{(pid=84334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 25 21:49:41 devstack cinder-volume[84334]: DEBUG cinder.manager [None req-56ed2c32-8db9-4b97-99f0-6e21e6b71c48 None None] Notifying Schedulers of capabilities ... {{(pid=84334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 25 21:49:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=92,cinder:INSERT=39,cinder:UPDATE=139,cinder:DELETE=8 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 25 21:49:48 devstack cinder-volume[84334]: DEBUG dbcounter [-] [84334] Writing DB stats cinder:SELECT=78,cinder:INSERT=21,cinder:UPDATE=125,cinder:DELETE=14 {{(pid=84334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}